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[57] 



ABSTRACT 



A personal communications system is described which 
includes components of software and hardware operat- 
ing in conjunction with a personal computer. The user 
interface control software operates on a personal com- 
puter, preferably within the Microsoft Windows® 
environment The software control system communi- 
cates with hardware components linked to the software 
through the personal computer serial communications 
port. The hardware components include telephone 
communication equipment, digital signal processors, 
and hardware to enable voice, fax and data communica- 
tion with a remote site connected through a standard 
telephone line. The functions of the hardware compo- 
nents are controlled by control software operating 
within the hardware component and from the software 
components operating within the personal computer. 
The major functions of the system are a telephone func- 
tion, a voice mail function, a fax manager function, a 
multi-media mail function, a show and tell function, a 
terminal function and an address book function. The 
telephone function allows the present system to operate, 
from the users perspective, as a conventional telephone 
using either hands-free, headset or handset operation. 
The telephone function is more sophisticated than a 
standard telephone in that the present system converts 
the voice into a digital signal which can be processed 
with echo cancellation, compressed, stored as digital 
data for later retrieval and transmitted as digital voice 
data concurrent with the transfer of digital information 
data. 



11 Claims, 52 Drawing Sheets 
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operation. The telephone Function is more sophisticated 

COMPUTER-BASED MULTIFUNCTION than a standard telephone in that the present system 

PERSONAL COMMUNICATIONS SYSTEM converts the voice into a digital signal which can be 

_ ___ , nm processed with echo cancellation, compressed, stored as 

FIELD OF THE INVENTION 5 digital data for later retrieval and transmitted as digital 

The present invention relates to communications voice data concurrent with the transfer of digital infor- 
systems and in particular to computer assisted digital mation data. 

communications including data, fax and digitized voice. The voice mail function of the present system oper- 
BACKORntlMn op thp rMVPNTinw ates as a telephone answering machine which can re- 

BACKGROUND OF THE INVENTION 10 compress and store voice messages for later re- 

A wide variety of communications alternatives are trieval or reuse in response messaging, 
currently available to telecommunications users. For The fax manager function of the present system al- 
example, facsimile transmission of printed matter is lows the transmission and reception of facsimile infor- 
available through what is commonly referred to as a mation. The software component of the present system 
standalone fax machine. Alternatively, fax-modem com- 15 operates in conjunction with other commercially avail- 
munication systems are currently available for personal able software programs such as word processors and 
computer users which combine the operation of a fac- the like to transmit and receive facsimile pages of digital 
simile machine with the word processor of a computer data stored on a computer system 
to transmit documents held on computer disk. Modem The multi-media mail component of the present sys- 
commuiucation over telephone lines in combination 20 tem Mows , he ^ lQ documcnts ^ ^ 

wuh a personal computer is also known m the art where dude text, graphics and voice mail messages which can 

™I^A^T T* 1 * ° m T to be sent as a combined package over conventional tele- 

another. Also, simultaneous voice and modem data „>™» i;-—. r-_ IT. inT r. j ^. 

transmitted over the same telephone line has been ac- £™ 1™!™ rec «Pt « a hke^onfigured site usmg the 
complished in several ways. 25 pT ^ 1 P tCm . . 

There is a need in the art, however, for a personal J^ST ♦ ™*P°nent of the present system 
communications system which combine; a widevariety I" thc °P Crat0r ! 0 simultaneously transmit voice 

of communication functions into an integrated hard- ^ co^^atoon to a remote site. This voice 

ware-software product such that the u^r can conve- °Tf J*** fu ° Ct10 ? dynamicall y allocates data band- 
niently choose a mode of communication and have that 30 Wldth over ^ telephone hne depending on the de- 
communication automatically invoked from a menu mands of vo,ce digitized signal, 
driven selection system. The terminal feature of the present system allows the 

user to establish a data communications session with 
SUMMARY OF THE INVENTION another computer system allowing the user's local com- 

The present disclosure describes a complex computer 35 P utcr system to operate as a dumb terminal, 
assisted communications system which contains multi- Tiie address function of the present system is a 
pie inventions. The subject of the present multiple in- versatile database that is built by the user and operates 
ventions is a personal communications system which in conjunction with the other components of the present 
includes components of software and hardware operat- system to dial and establish communication links with 
ing in conjunction with a personal computer. The user 40 remote sites to enable data communication, voice mail, 
interface control software operates on a personal com- facsimile, file transfer all in an automated mode without 
puter, preferably within the Microsoft Windows® user intervention, 

environment. The software control system communi- Th e hardware components of the present system 
cates with hardware components linked to the software include circuitry to enable digital data communication 
through the personal computer serial communications 45 and facsimile communication over standard telephone 
port The hardware components include telephone Iuics - The hardware components also include circuitry 
communication equipment, digital signal processors, to convert the voice to digital data and compress that 
and hardware to enable both fax and data communica- data for transfer to the software component on the 
tion with a hardware components at a remote site con- personal computer or transfer it over the telephone lines 
nected through a standard telephone line. The functions 50 to a remote site. 

of the hardware components are controlled by control Many of the functions of the present system are ac- 
software operating within the hardware component and complished by including a voice control digital signal 
from the software components operating within the processor (DSP) to operate in conjunction with a data/- 
personal computer. fax modem implemented with a data pump DSP. The 

Communications between the software components 55 data pump DSP and the voice control DSP accomplish 
running on the personal computer and the local hard- the following functions in an integrated hardware ar- 
ware components over the serial communications link is rangement: 

by a special packet protocol for digital data communica- A sophisticated telephone apparatus with its attached 
tions. This bi-directional communications protocol al- handset, headset and a built-in hands free telephone 
lows uninterrupted bidirectional full-duplex transfer of 60 operation using the integrated microphone and speaker 
both control information and data communication. system. The hands free telephone works in full duplex 

The major functions of the present system are a tele- mode through the use of voice echo cancellation per- 
phone function, a voice mail function, a fax manager formed by the voice control DSP. 
function, a multi-media mail function, a show and tell The voice control DSP in conjunction with a tele- 
function, a terminal function and an address book func- 65 phone CODEC provides voice compression which can 
tion. The telephone function allows the present system be sent to the computer system that is attached the 
to operate, from the users perspective, as a conventional RS232 port for storage and later retrieval. The corn- 
telephone using either hands-free, headset or handset pressed voice from the voice control DSP can also be 
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multiplexed with the input data stream from the per- FIG. 2 is the main menu icon for the software compo- 
sonal computer with dynamic time allocation. Whereas, nents operating on the personal computer; 
the input data from the attached computer is transmit- FIG. 3 is a block diagram of the hardware compe- 
ted using the error control protocol like MNP or V.42 nents of the present system; 

with or without data compression <e.g., V.42bis), the 5 FIG. 4 is a key for viewing the detailed electrical 

speech is packetized using a different header defining it schematic diagrams of FIGS. 5A-10C to facilitate un- 

as a speech packet and then transmitted through a con- derstanding of the interconnect between the drawings; 

troller. The speech packets, like the data packets, have FIGS. 5A-5C «A-6C, 7A-7C, 8A-8B, 9A-9C and 

the attached CRC codes. However, the speech packets 10A-10C are detailed electrical schematic diagrams of 

are not sequenced and the like hardware at the receiv- 10 the circuitry of the hardware components of the present 

ing end ignores the accompanying CRC codes for voice system; 

packets and passes the voice packets to the voice con- FIG. 11 is a signal flow diagram of the speech com- 

trol DSP for decompression. The decompressed speech pression algorithm; 

is played through one of the telephone receiving units, FIG j s a detailed function flow diagram of the 

i.e. f the headset, handset or the built in speaker. 15 speech compression algorithm; 

The voice control DSP allows the compressed FIG- 13 is a detailed function flow diagram of the 

speech to be recorded on a recording media, e.g-, the speech decompression algorithm; 

hard disc drive of the attached computer system. This FIG. 14 is a detailed function flow , diagram of the 

provides the function of an answering machine. In addi- ^0 cancellation algorithm; 

tion to the answering machine function, the recorded 20 pj G 15 a detailed function flow diagram of the 

speech can be provided for the voice mail functions. voice/data multiplexing function; 

The special packet protocol over the RS232 interface pj G jg a perspective view of the components of a 

between the software component and the hardware digital computer compatible with the present invention; 

component that governs the operation of the hardware FIG. 17 is a block diagram of the software structure 

component is so designed that it allows various control 25 ^^^5^ ^th the present invention; 

functions to be intermixed with data over the RS232 pjQ 18 ^ a Mock diagram of the control structure of 

serial port. The software component of the present software compatible with the present invention; 

system accepts the generic AT modem commands pj G 19 & a block diagram of the main menu struc- 

when not in the special packet mode. When the hard- tufe of software compatible with the present invention; 

ware component is configured to accept the packet 30 pIG ^ a flow diagram of answer mode software 

level protocol over the RS232 port, it can bemade to ^ tible ^ thc present invention; 

switch to the generic command mode through tne use pj G 2 l is a flow diagram of telephone software 

of a break sequence. compatible with the present invention; 

The hardware components of the present system FJG 22 is a flow diagram of voice mail software 

functions as a data/fax modem when the speech com- 35 ^ ^ the present invention; 

pression or telephone mode is not invoked. IHe packet ^ ^ ^ now diagram of fax manager software 

mode or the generic AT command mode may be used ^ the present invention; 

for this purpose. FIG. 24 is a flow diagram of multi-media mail soft- 

The hardware components of the presen system ware c tiblc ^u, thc presC nt invention; 

incorporate a provision for a special link integnty 40 r diagram of a timing loop compatible 

packet to facilitate the device to work over cellular J^^ma* mve ntion; 

networks. This scheme allows the modem in one o its ^X^flow aC^n of telephone control soft- 
plurality of modes to ignore the earner dropouts (sdec- patible with the present invention; 
tive fading) inherent m the cellular networks Such a wa £^P* fiow diagram of voice mail control soft- 
scheme does not ™^«^<™^J** 45 w £ compile with present invention; 
modem. The disconnect of the cellular J» m 2S is a flow diagram of high resolution fax 
done through a negotmtK>n sch^mg packet inter- ^ ^ ^ ^ prcscnt invention; 
change between the two ends of the hnk. FIG 29 is a flow diagram of low resolution fax driver 

In cellular networks the mulaplexed voice da* tech- J£> prcsent inveri tion; 

nology of the present system aUows a ^c.W"" 50 30 is a flow diagram of multi media mail control 
tofunction as a smart t^ephone^ an^ J^^m^c^X^ present invention; 

modem as weU as a fax modem These featui^ along diagram of multi media mail editor 

with the voice demultiplex ^V™^*™*£ sof^e corn^o^Ie^^e present invmtion; 

user complete freedom to use his or her moving vehicle ^g"^ diagram C J mlllti mcdia mail trans- 

^ These S^fS* hardware component of the o* software compatible with the present invention; 

prSnTsySe^Song ^th *e features ofthe software FIG. 33 is a flow diagram of mult, media mail recede 

presem system juung Wl "' * „„ software compatible with the present invention; 

'vST^h a P ^p.r F,G. aStTflow dia^of show a*, «U — 

mob " c * software compatible with the present invention; 

DESCRIPTION OF THE DRAWINGS FIG. 36 is a flow diagram of voice mail transmit 

In the drawings, where like numerals describe like software compatible with the present invention; 
com^^Z^the several views. 65 FIG .37 isafl ow dia g-^^SoT"* 

FIG 1 shows the telecommunications environment ware compatible with the present invention 

wi!h\n whS?the present may operate in several of the FIG. 38 is a flow diagram of an outgoing timer loop 

possible modes of communication; compatible with the present invention, 
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FIG. 39 is a flow diagram of an outgoing timer loop nicating over standard telephone line 30 to facsimile 
compatible with the present invention; machine 60. In another alternative use, the present sys- 

FIG. 40 is an initialization screen display compatible tem may be communicating over a standard telephone 
with the present invention; line 30 to another personal computer 80 through a rc- 

FIG. 41 is a communication port setup screen display 5 mote modem 70. In another alternative use, the present 
compatible with the present invention; system may be communicating over a standard tele- 

FIG. 42 is an answer mode setup screen display com- phone line 30 to a standard telephone 90. Those skilled 
patiblc with the present invention; in the art will readily recognize the wide variety of 

FIG. 43 is a hold call setup screen display compatible communication interconnections possible with the pres- 
with the present invention; 10 ent system by reading and understanding the following 

FIG. 44 is a voice mail setup screen display compati- detailed description, 
ble with the present invention; The ornamental features of the hardware components 

FIG. 45 is a PBX setup screen display compatible 20 of FIG. 1 are claimed as part of patent application 
with the present invention; Ser. No. 29/001368, filed Nov. 12, 1992 entitled "Tele- 

FIG. 46 is a fax setup screen display compatible with 15 phone/Modem case for a Computer-Based Multifunc- 
the present invention; tion Personal Communications System" assigned to the 

FIG. 47 is a multi-media mail setup screen display same assignee of the present inventions and hereby 
compatible with the present invention; incorporated by reference. 

FIG. 48 is a show and tell setup screen display com- 
patible with the present invention; 20 General Overview 

FIG. 49 is a telephone control screen display compat The present inventions are embodied in a commercial 

ible with the present invention; product by the assignee, MultiTech Systems, Inc. The 

FIG. 50 is a voice mail control screen display com- software component operating on a personal computer 
patible with the present invention; is sold under the commercial trademark of MultiEx- 

FIG. 51 is a voice editor screen display compatible 23 pressPCSTM personal communications software while 
with the present invention; the hardware component of the present system is sold 

FIG. 52 is a fax manager control screen display com- under the commercial name of MultiModemPCS tm , 
patible with the present invention; Intelligent Personal Communications System Modem. 

FIG. 53 is a multi-media mail control screen display In the preferred embodiment, the software component 
compatible with the present invention; 30 runs under Microsoft ® Windows ® however those 

FIG. 54 is a show and tell control screen display skilled in the art wfll readily recognize that the present 
compatible with the present invention; system is easily adaptable to run under any single or 

FIG. 55 is an address book control screen display multi-user, single or multi-window operating system, 
compatible with the present invention; The present system is a multifunction communication 

FIG. 56 is a voice message destination screen display 35 system which includes hardware and software compo- 
compatible with the present invention; and nents. The system allows the user to connect to remote 

FIG. 57 is a message composer screen display com- locations equipped with a similar system or with 
patible with the present invention. modems, facsimile machines or standard telephones 

DETAILED DESCRIPTION OF THE m Z^ltfZ^l^ 0 ™ ^ ^ ^ 

PREFERRED EMBODIMENTS 40 P 00 ^' 0 ^ present system includes a number of mod- 

ules which are described in more detail below. 

The specification for the multiple inventions de- FIG. 2 is an example of the Windows <§>-based main 
scribed herein includes the present description, the menu icon of the present system operating on a personal 
drawings and a microfiche appendix. In the following computer. The functions listed with the icons used to 
detailed description of the preferred embodiment, refer- 45 invoke those functions are shown in the preferred em- 
ence is made to the accompanying drawings which bodiment. Those skilled in the art will readily recognize 
form a part hereof, and in which is shown by way of that a wide variety of selection techniques may be used 
illustration specific embodiments in which the inven- to invoke the various functions of the present system, 
tions may be practiced. These embodiments are de- The icon of FIG. 2 is part of patent application No. 
scribed in sufficient detail to enable those skilled in the 50 29/001397, filed Nov. 12, 1992 entitled "Icons for a 
art to practice the invention, and it is to be understood Computer-Based Multifunction Personal Communica- 
that other embodiments may be utilized and that stnic- tions System" assigned to the same assignee of the pres- 
tural changes may be made without departing from the em inventions and hereby incorporated by reference, 
spirit and scope of the present inventions. The follow- The telephone module allows the system to operate 
ing detailed description is, therefore, not to be taken in 55 as a conventional or sophisticated telephone system, 
a limiting sense, and the scope of the present inventions The system converts voice into a digital signal so that it 
is defined by the appended claims. can be transmitted or stored with other digital data, like 

FIG. 1 shows a typical arrangement for the use of the computer information. The telephone function supports 
present system. Personal computer 10 is running the PBX and Centrex features such a call waiting, call for- 
software components of the present system while the 60 warding, caller ID and three-way calling. This module 
hardware components 20 include the data communica- also allows the user to mute, hold or record a conversa- 
tion equipment and telephone headset. Hardware com- tion. The telephone module enables the handset, head- 
ponents 20 co mm un i ca t e over a standard telephone line set or hands-free speaker telephone operation of the 
30 to one of a variety of remote sites. One of the remote hardware component. It includes on-screen push button 
sites may be equipped with the present system including 65 dialing, speed-dial of stored numbers and digital record- 
hardware components 20a and software components ing of two-way conversations. 

running on personal computer 10a. In one alternative The voice mail portion of the present system allows 
use, the local hardware components 20 may be commu- this system to operate as a telephone answering machine 



02/10/2003, EAST 



Version: 1.03.0007 



5,452,289 

7 8 

by storing voice messages as digitized voice files along Hardware Components 

with a rime/date voice stamp. The digitized voice files 

can be saved and sent to one or more destinations imme- FIG. 3 is a block diagram of the hardware compo- 

diately or at a later time using a queue scheduler. The aents of the present system corresponding to reference 

user can also listen to, forward or edit the voice mes- 5 number 20 of FIG. 1. These components form the link 

sages which have been received with a powerful digital between the user, the personal computer running the 

voke editing component of the presenT system. This software component of the s^tem an d the**- 

module also^ LtwS 

sent at preselected times and allowstbe users to create ^ ; K ^ asaial communications port con- 
outgoing messages with the voice eduon L*ed to the personal computer. The interface protocol 
The fax manager portion of the present system is a ^ ^ ordcr 2 ^ dcfn|ed such that other software 
queue for incoming and outgoing facsimile pages. In the ^ ^ runnill on personal computer 
preferred embodiment of the present system this func- ' ^ d £* d ^ implemented which would be 
tion is tied into the Windows "print" command once the 15 ^ u of controlling the hardware components shown 
present system has been installed. This feature allows m pj G 3 by thc control and communications 
the user to create faxes from any Windows (ghbascd protocol defined below. 

document that uses the "print" command. The fax man- ln ^ prc f crrcc embodiment of the present system 
ager function of the present system allows the user to thrce alternate telephone interfaces are available the 
view queued faxes which are to be sent or which have ^ telephone handset 301, a telephone headset 302, and a 
been received. This module creates queues for outgoing hands-free microphone 303 and speaker 304. Regardless 
faxes to be sent at preselected times and logs incoming Q f the telephone interface, the three alternative inter- 
faxes with time/date stamps. faces connect to the digital telephone coder-decoder 
The multi-media mail function of the present system (CODEC) circuit 305. w 1(l L 
is a utility which allows the user to compose documents 2 i Tlieidigitatacfepn~6^<^ 
that include text, graphics and voice messages using the wrth*the^voic*-'control^ ^ 

message composer function of the present system, de- ^aA&306 which^m^des^a-voice^contfol^DSP 5 ^^ 
scribed more fully below. The multi-media mail utility GQDECPThis circuit does digital to analog (D/A) 
of the present system allows the user to schedule mes- conversion, analog to digital (A/D) conversion, co- 
sages for transmittal and queues up the messages that 30 ding/decoding, gain control and is the interface be- 
have been received so that can be viewed at a later time. tween the voice control DSP circuit 306 and the tde- 
The show and tell function of the present system phone interface. The CODEC of the voice control 
allows the user to establish a data over voice (DOV) circuit 306 transfers digitized voice information in a 
communications session. When the user is transmitting compressed format to multiplexor circuit 310 to analog 
data to a remote location similarly equipped, the user is 35 telephone line interface 309. 

able to talk to the person over the telephone line while The C^E^th^Vctorcoim^^rcmt^e : is actu- 

concurrently transferring the data. This voice over data ally an integral component of a voice control digital 

function is accomplished in the hardware components signal i processor mtegrated as d^bed more 

of the present sysfem. It digitizes the voice and trans- fully below. The voice ~%^<*^ 

mm it in a dynamically changing allocation of voice «> trols the digital telephone ^2?^ n C ^*^ 5 ' ^ 

data and d^T. Ta^™t^l^ 'Tul^^ the 
sion. The allocation at a given moment » selected de- P ^ sp ^ ^ ^ ^ Dsp 

pending on me amount of voice cLut 311 for transmission of information on the tdc 
requiredtobetran^erredC^etvoicemtervalsallCK^te ^ ^ telephone line interface circuit 309. 

greater space to the digital data transmission. K Vhe data pump circuit 311 also includes a digital 

The terminal function of the present system allows ^ rocessor msp) and a CODEC for communicat- 
the user to establish a data communications session with * ^ ^ telephone Hne mterface 309 through MUX 
another computer which is equipped with a modem but cAro(A 31Q The ?ump D sp and CODEC of circuit 
which is not equipped with the present system. This ^ 3U ?eT f onns functions such as modulation, demodula- 
feature of the present system is a Windows ©-based lion ^ cancellation to communicate over the 
data communications program that reduces the need for telephone line interface 309 using a plurality of telecom- 
issuing "AT" commands by providing menu driven and mU nications standards including FAX and modem pro- 
"pop-up" window alternatives. tocols. 

The address book function of the present system is a 55 ^Rie^ma^con ttofle^^ 

database that is accessible from all the other functions of data r pOmp'circui73n*ana the 'voice control DSP circuit 

the present system. This database is created by the user 30$ through serial input/output and clock timer control 

inputting destination addresses and telephone numbers (SIO/CTC) circuits 312 and dual port RAM circuit 308 
for data communication, voice mail, facsimile transmis- respectively. The main controller circuit 313 communi- 
sion, modem communication and the like. The address $o cates with the voice control DSP 306 through dual port 
book function of the present system may be utilized to RAM circuit 308. In this fashion digital voice data can 
broadcast communications to a wide variety of recipi- be read and written simultaneously to the memory por- 
ents. Multiple linked databases have separate address tions of circuit 308 for high speed communication be- 
books for different groups and different destinations tween the user (through interfaces 301, 302 or 303/304) 
may be created by the users. The address book function 65 and the personal computer connected to serial interface 
includes a textual search capability which allows fast circuit 315 and the remote telephone connection con- 
and efficient location of specific addresses as described nected through the telephone line attached to line inter- 
more fully below. face circuit 309. 
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As described more fully below, the main controller tized and compressed voice patterns are passed through 
circuit 313 includes, in the preferred embodiment, a dual port ram circuit 308 to the main controller circuit 
microprocessor which controls the functions and opera- 313 where they are transferred through the serial inter- 
tion of all of the hardware components shown in FIG. face to the personal computer using a packet protocol 
3. The main controller is connected to RAM circuit 316 5 defined below. The voice patterns are then stored on 
and an programmable and electrically erasable read the disk of the personal computer for later use in multi- 
only memory (PEROM) circuit 317. The PEROM cir- media mail, for voice mail, as a pre-recorded answering 
cuit 317 includes non-volatile memory in which the machine message or for later predeterrnined transmis- 
executable control programs for the voice control DSP sion to other sites. . 
circuits 306 and the main controller circuits 313 operate. 10 For the present system to operate as an answering 

The RS232 serial interface circuit 315 communicates machine, the hardware components of FIG. 3 are 
to the serial port of the personal computer which is placed in answer mode. An incoming . telephone ring js_ 
running the software components of the present system. detected through the tel(g^Uncbterfr^irHuf309 
The RS232 serial interface circuit 31S is connected to a affcflhe^mlBT^rltroller 

serial input/output circuit 314 with main controller 15 passes the information off to the personal computer 
circuit 313. SIO circuit 314 is in the preferred embodi- through the RS232 serial interface circuit 315. The 
ment, a part of SIO/CTC circuit 312. telephone line interface circuit 309 seizes the telephone 

Functional Operation of the Hardware Components t0 maVe tele P*»* connection. A pre-recorded 

. message may be sent by the personal computer as com- 

Refernng once again to FIG. 3, the multiple and 20 pressed and digitized speech through the RS232 inter- 
selectable functions described in conjunction with FIG. face to the main controller circuit 313. The compressed 
2 are all implemented in the hardware components of and digitized speech from the personal computer is 
FIG. 3. Each of these functions will be discussed in passed from main controller circuit 313 through dual 
<U Il , i. r P° n ram circuit 308 to the voice control DSP circuit 

The telephone function 115 is implemented by the 23 306 where it is uncompressed and converted to analog 
user either selecting a telephone number to be dialed voice patterns. These analog voice patterns are passed 
from the address book 127 or manually selecting the through multiplexor circuit 310 to the telephone line 
number through the telephone menu on the personal interface 309 for transmission to the caller. Such a mes- 
computer. The telephone number to be dialed is down- sage may invite the caller to leave a voice message at 
loaded from the personal computer over the serial inter- 30 the sound of a tone. The incoming voice messages are 
face and received by main controller 313. Main control- received through telephone line interface 309 and 
ler 313 causes the data pump DSP circuit 311 to seize passed to voice control circuit 306. The analog voice 
the telephone line and transmit the DTMF tones to dial patterns are digitized by the integral CODEC of voice 
a number. Main controller 313 configures digital tele- control circuit 306 and the digitized voice patterns are 
phone CODEC circuit 305 to enable either the handset 35 compressed by the voice control DSP of the voice 
301 operation, the microphone 303 and speaker 304 control circuit 306. The digitized and compressed 
operation or the headset 302 operation. A telephone speech patterns arc passed through dual port ram circuit 
connection is established through the telephone line 308 to the main controller circuit 313 where they are 
interface circuit 309 and communication is enabled. The transferred using packet protocol described below 
user's analog voice is transmitted in an analog fashion to 40 through the RS232 serial interface 315 to the personal 
the digital telephone CODEC 305 where it is digitized. computer for storage and later retrieval. In this fashion 
The digitized voice patterns are passed to the voice the hardware components of FIG. 3 operate as a trans- 
control circuit 306 where echo cancellation is accora- mit and receive voice mail system for implementing the 
plished, the digital voice signals are reconstructed into voice mail function 117 of the present system, 
analog signals and passed through multiplexor circuit 45 The hardware components of FIG. 3 may also ope? 7 " 
310 to the telephone line interface circuit 309 for analog ate to facilitate the fax manager function 119 of FIG. 2. 
transmission over the telephone line. The incoming In fax receive mode, an incoming telephone call will be 
analog voice from the telephone connection through detected by a ring detect circuit of the telephone line 
telephone connection circuit 309 is passed to the inte- interface 309 which will alert the main controller circuit 
gral CODEC of the voice control circuit 306 where it is 50 313 to the incoming call. Main controller circuit 313 
digitized. The digitized incoming voice is then passed to will cause line interface circuit 309 to seize the tele- 
digital telephone CODEC circuit 305 where it is recon- phone line to receive the call. Main controller circuit 
verted to an analog signal for transmission to the se- 313 will also concurrently alert the operating programs 
lected telephone interface (either the handset 301, the on the personal computer through the RS232 interface 
microphone/speaker 303/304 or the headset 302). 55 using the packet protocol described below. Once the 
Voice Control DSP circuit 306 is programmed to per- telephone tine interface seizes the telephone Hne, a fax 
form echo cancellation to avoid feedback and echoes carrier tone is transmitted and a return tone and hand- 
between transmitted and received signals, as is more shake is received from the telephone line and detected 
fully described below. by the data pump circuit 311. The reciprocal transmit 

In the voice mail function mode of the present sys- 60 and receipt of the fax tones indicates the imminent re- 
tem, voice messages may be stored for later transmis- ceipt of a facsimile transmission and the main controller 
son or the present system may operate as an answering circuit 313 configures the hardware components of 
machine receiving incoming messages. For storing digi- FIG. 3 for the receipt of that information. The neces- 
tizcd voice, the telephone interface is used to send the sary handshaking with the remote facsimile machine is 
analog speech patterns to the digital telephone CODEC 65 accomplished through the data pump 311 under control 
circuit 305. Circuit 305 digitizes the voice patterns and of the main controller circuit 313. The incoming data 
passes them to voice control circuit 306 where the digi- packets of digital facsimile data are received over the 
tized voice patterns are digitally compressed. The digi- telephone line interface and passed through data pump 
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circuit 311 to main controller circuit 313 which for- data transmission may be accomplished simultaneously 
wards the information on a packet basis (using the with the voice communication between both sites. This 
packet protocol described more fully below) through mode of operation assumes a like configured remote 
the serial interface circuit 315 to the personal computer site. The hardware components of the present system 
for storage on disk. Those skilled in the art will readily 5 also include a means for sending voice/data over cellu- 
recognize that the FAX data could be transferred from lar links. The protocol used for transmitting multiplexed 
the telephone line to the personal computer using the voice and data include a supervisory packet described 
same path as the packet transfer except using the normal more fully below to keep the link established through 
AT stream mode. Thus the incoming facsimile is auto- the cellular link. This supervisory packet is an acknowl- 
maticaDy received and stored on the personal computer 10 edgement that the link is still up. The supervisory 
through the hardware components of FIG. 3. packet may also contain link information to be usedfor 

A facsimile transmission is also facilitated by the adjusting various link parameters when needed. This 
hardware components of FIG. 3. The transmission of a supervisory packet is sent every second when data is 
facsimile may be immediate or queued for later trans- not being sent and if the packet is not acknowledged 
mission at a predetermined or preselected time. Control 15 after a si>edfiednimiberofattemp^ me protocol would 
packet information to configure the hardware compo- then give an indication that the cellular link is down and 
nents to send a facsimile are sent over the RS232 serial then allow the modem to take action. The action could 
interface between the personal computer and the hard. be for example; change speeds, retrain, or hang up. The 
ware components of FIG. 3 and are received by main use of supervisory packets is a novel method of mam- 
controller circuit 313. The data pump circuit 311 then 20 taming inherently intermittent cellular links when trans- 
dials the recipient's telephone number using DTMF mitring multiplexed voice and data, 
tones or pulse dialing over the telephone line interface The voice portion of the voice over data transmission 
circuit 309. Once an appropriate connection is estab- of the show and tell function is accomplished by recav- 
lished with the remote facsimile machine, standard fac- ing the user's voice through the telephone interface 301, 
simile handshaking is accomplished by the data pump 25 302 or 303 and the voice information is digitized by the 
circuit 311. Once the facsimile connection is established, digital telephone circuit 305. The digitized voice infer- 
tile digital facsimile picture information is received mation is passed to the voice control circuit 306 where 
through the data packet protocol transfer over serial the digitized voice information is compressed usinga 
line interface circuit 315, passed through main control- voice compression algorithm described more fully be- 
ler circuit 313 and data pump circuit 311 onto the tele- 30 low. The digitized and compressed voicemformation is 
phone line through telephone line interface circuit 309 passed through dual port RAM circuit 308 to the mmn 
for receipt by theremote facsimile machine. controller circuit 313. During quiet periods of the 

The operation of the multi-media mail function 121 of speech, a quiet nag is passed from voice control circuit 
FIG 2 tsalso facilitated by the hardware components 306 to the main controller 313 through a packet transfer 
of FIG. 3. A multimedia transmission consists of a com- 35 protocol described below by a dual port RAM circuit 
bination of picture information, digital data and digi- 308, 

tized voice information. For example, the type of multi- Simultaneous with the digitizing compression and 
media information transferred to a remote site using the packetizing of the voice information is the receipt of the 
hardware components of FIG. 3 could be the multime- packetized digital information from the personal com- 
dia format of the Microsoft® Multimedia Wave® 40 puter over interface line circuit 315 by main controller 
format with the aid of an Intelligent Serial Interface circuit 313. Main controller circuit 313 in the show and 
(ISI) card added to the personal computer. The multi- tell function of the present system must efficiently and 
media may also be the type of multimedia information effectively combine the digitized voice information 
assembled by the software component of the present with the digital information for transmission over the 
system which is described more fully below. 45 telephone line via telephone line £^ 

The multimedia package of information including As described above and as described more fully below, 
text, graphics and voice messages (collectively called main controller circuit 313 dynamically changes the 
the rnutamedia document) may be transmitted or re- amount of voice information and digital information 
ceived through the hardware components shown in transmitted at any given period of time depending upon 
FIG 3 For example, the transmission of a multimedia 50 the quiet times during the voice transmissions. For ex- 
document through the hardware components of FIG. 3 ample, during a quiet moment where there is no speech 
is accomplished by transferring the multimedia digital information being transmitted, main controller circuit 
information using the packet protocol described below 313 ensures that a higher vohime of ^rt?*rfoT- 
over the RS232 serial interface between the personal mation be transmitted over the telephone line interface 
computer and the serial line interface circuit 315. The 35 in lieu of digitized voice information. 
P^keTare then transferred through main controller Also, as described more fully below, the packets of 
circuit 313 through the data pump circuit 311 on to the digital data transmitted over the telephone Interface 
telephone line forreccipt at a remote site through tele- with the transmission packet protocol described below, 
phone line interface circuit 309. In a similar fashion, the requires 100 percent accuracy in the transmission of the 
multimedia documents received over the telephone line 60 digital data, but a lesser standard of accuracy for the 
from the remote site are received at the telephone line tnmsrmsnon and receipt of the dl f tt ^°^j.°™f h 
interface circuit 309, passed through the data pump tion. Since digital information must be transmrtted with 
circuit 311 for receipt and forwarding by the main con- 100 percent accuracy, a corrupted packet of digital 
troller circuit 313 over the serial line interface circuit information received at the remote site must be retrans- 
3 15 65 mined. A retransmission signal is communicated back 

The show and tell function 123 of the present system to the local site and the packet of digital information 
allows the user to establish a data over voice communi- which was corrupted during transmission is retransmit- 
cation session. In this mode of operation, full duplex ted. If the packet transmitted contained voice data. 
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however, the remote site uses the packets whether they main controller circuit 313 over the serial line interface 
were corrupted or not as long as the packet header was circuit 315 to the personal computer, 
intact. If the header is corrupted, the packet is dis- As described above, and more fully below, the ad- 
carded. Thus, the voice information may be corrupted dress book function of the present system is primarily a 
without requesting retransmission since it is understood 5 support function for providing telephone numbers and 
that the voice information must be transmitted on a real addresses for the other various functions of the present 
time basis and the corruption of any digital information system, 
of the voice signal is not critical. In contrast to this the 

transmission of digital data is critical and retransmission Detailed Electrical Schematic Diagrams 

of corrupted data packets is requested by the remote 10 The detailed electrical schematic diagrams comprise 

Slte - FIGS. 5A-C 6A-C, 7A-C. 8A-B, 9A-C and 10A-C. 

The transmission of the digital data follows the FIG. 4 shows a key on how the schematic diagrams 

CCITT V.42 standard, as is wdl known in the industry may be conveniently arranged to view the passing of 

and as described in the CCITT Blue Book, volume VIII signals on the electrical lines between the diagrams. The 
entitled Data Communication over the Telephone Net- 15 electrical connections between the electrical schematic 

work, 1989. The CCITT V.42 standard is hereby incor- diagrams are through the designators listed next to each 

porated by reference. T he v oice data packet informs- wire. For example, on the right side of FIG. 5A, address 

tion also follows the CCITT V.42 standard, but uses a lines A0-A19 are attached to an address bus for which 

different header format so the receiving site recognizes the individual electrical lines may appear on other pages 
the difference between a data packet and a voice packet 20 as A0-A19 or may collectively be connected to other 

The voice packet is distinguished from a data packet by schematic diagrams through the designator "A" in the 

using undefined bits in the header (80 hex) of the V.42 circle connected to the collective bus. In a like fashion, 

standard. The packet protocol for voice over data trans- other electrical lines designated with symbols such as 

mission during the show and tell function of the present RNGL on the lower left-hand side of FIG. 5A may 
system is described more fully below. 23 connect to other schematic diagrams using the same 

Since the voice over data communication with the signal designator RNGL. 
remote site is full-duplex, incoming data packets and Beginning with the electrical schematic diagram of 
incoming voice packets are received by the hardware FIG. 7C, the telephone line connection in the preferred 
components of FIG. 3. The incoming data packets and ^ embodiment is through connector J2 which is a stan- 
voice packets are received through the telephone line dard six-pin modular RJ-1 1 jack. In the schematic dia- 
lnterface circuit 309 and passed to the main controller gram of FIG. 7C, only the tip and ring connections of 
circuit 313 via data pump DSP circuit 311. The incom- the first telephone circuit of the RJ- 1 1 modular connec- 
mg data packets are passed by the main controller cir- tor are used. Ferrite beads FB3 and FB4 are placed on 
cuit 313 to the serial interface circuit 315 to be passed to 35 the tip and ring wires of the telephone line connections 
the personal computer. The incoming voice packets are to remove any high frequency or RF noise on the in- 
passed by the main controller circuit 313 to the dual coming telephone line. The incoming telephone line is 
port RAM circuit 308 for receipt by the voice control also overvoltage protected through SIDACTOR R4. 
DSP circuit 306. The voice packets are decoded and the The incoming telephone line may be full wave rectified 
compressed digital information therein is uncompressed ^ by the full wave bridge comprised of diodes CR27 
by the voice control DSP of circuit 306. The uncom- CR28, CR29 and CR31. Switch S4 switches between 
pressed digital voice information is passed to digital direct connection and full wave rectified connection 
telephone CODEC circuit 305 where it is reconverted depending upon whether the line is a non-powered 
to an analog signal and retransmitted through the tele- leased line or a standard telephone line. Since a leased 
phone line interface circuits. In this fashion full-duplex 45 line is a "dead" line with no voltage, the full-wave 
voice and data transmission and reception is accom- rectification is not needed. 

pushed through the hardware components of FIG. 3 Also connected across the incoming telephone line is 

durmg the show and tell functional operation of the a ring detect circuit Optical isolator U32 (part model 

present system. number CNY17) senses the ring voltage threshold when 

Terminal operation 125 of the present system is also 50 it exceeds the breakdown voltages on zener diodes CRl 

supported by the hardware components of FIG. 3. Ter- and CR2. A filtering circuit shown in the upper right 

mmal operation means that the local personal computer corner of FIG. 7C creates a long RC delay to sense the 

simply operates as a "dumb" terminal including file constant presence of an AC ring voltage and buffers 

transfer capabilities. Thus no local processing takes that signal to be a binary signal out of operational ampli- 

place other than the handshaking protocol required for 55 fier U25 (part model number TL082). Thus, the RNGL 

the operation of a dumb terminal. In terminal mode and J1RING signals are binary signals for use in the 

operation, the remote site is assumed to be a modem remaining portions of the electrical schematic diagrams 

connected to a personal computer but the remote site is to indicate a presence of a ring voltage on the telephone 

not necessarily a site which is configured according to line. 

the present system. In terminal mode of operation, the 60 The present system is also capable of sensing the 
command and data information from personal computer caller ID information which is transmitted on the tele- 
is transferred over the RS232 serial interface circuit 315, phone line between rings. Between the rings, optically 
forwarded by main controller circuit 313 to the data isolated relays U30, U31 on FIG. 7C and optically iso- 
pump circuit 311 where the data is placed on the tele- lated relay U33 on FIG. 7B all operate in the period 
phone line via telephone line interface circuit 309. 65 between the rings so that the FSK modulated caller ID 
In a reciprocal fashion, data is received from the information is connected to the CODEC and data pump 
telephone line over telephone line interface circuit 309 DSP in FIGS. 8A and 8B, as described more fully be- 
and simply forwarded by the data pump circuit 311, the low. 
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Referring now to FIG. 7B, more of the telephone line (shown in FIG. 3) and the voice control CODEC of 
filtering circuitry is shown. Some of the telephone line circuit 306 (also shown tn FIG. 3). The signal lines 
buffering circuitry such as inductor LI and resistor Rl AOUTN and AOUTP correspond to signals received 
^fo^onT^Tare connected for various telephone from the voice control CODEC of circuit 306. CODEC 
line standards used around the word to meet local re- 5 U35 is part of circuit 311 of FIG. 3. 
quirements. For example, Switzerland requires a 22 The main controller of controller circuit 313 and the 
millihenry inductor and IK resistor in series the line. support circuits 312, 314, 316, 317 and 308 are shown ui 
For all other countries, the IK resistor is replaced with FIGS. 5A-5C In the preferred embod^ent of the 
a 0 ohm resistor present system, the mam controller is a 280180 eight-btt 

Relav U29 shown in FIG. 7B is used to accomplish 10 microprocessor chip. In the preferred implementation, 
pulsTdLing by opening and shorting the tip and ring microcontroller chip U17 is a 

wires. OpSal rel^l engaged during pulse dialing part number Z84CO! by ^g, Inc. of C^^l, Calrf. 
sothauhe tip and ring are shorted directly. Transistors (also available from Hitachi ^m«conductor as part 
02 and Q3^ong with the associated discrete resistors number HD64 1802). The 2flogZ80180 e ,ght-bit imcro- 
compris^a holding circuit to provide a current path or 15 processor operates at 12 MHzinternal clock speed by 
current loop on the telephone line to grab the line. means of an external crystal XT Ah, which in the pre- 

FIG 7 A show* the telephone interface connections ferred embodiment, is a 24.576 MHz crystal. The crystal 
between the hardware components of the present sys- circuit includes capacitors C4 and C5 which are 20 pf 
tern and the handset, headseVand microphone. capacitors and resistor R28 which is a 33 ohm resistor. 

The connections Tl and T2 for the telephone line 20 The crystal and support circuitry is connected accord- 
from FIG. 7B are connected to transformer TR1 shown ing to manufacturer's specifications found m the ZJog 
hVthe electrical schematic diagram of FIG. 8B. Only Intelligent : Pm^era^utrollers Data Book ^pubhshed 
the AC components of the signal pass through trans- by Zilog, Inc. The product description for the 284C01 
Srmef^^nnLon If sigSS attach* to the Z80180 CPU from the 284C01 ZBO CPU ™ Spec- 
secondary of TR1 is shown for both transmitting and 25 ification pgs 43-73 of the Zdog 199^ In^lhgent Penph- 
receivmg information over the telephone line. eral Controllers databook is hereby incorporated by 

Incoming signals are buffered by operational amplifi- reference, 
ers U27A and U27B. The first stage of buffering using The ZS0180 microprocessor u tmcrocontroUer chip 
operational amplifier U27B is used for echo suppression U17 is intimately connected to a ^al/paraUel I/O 
sTthat the transmitted information being placed on the 30 counter timer chip U15 wtoh * m the P"ferred em- 
Peptone line is not fed back into the receive portion of bodiment, a Zilog B4C90 CMOS 280 KIO s«W P aral- 
the present system. The second stage of the input buff- lel/counter/umer mtegrated 

ering through operational amplifier U27A is configured Zilog, Inc. This multi-function I/O chip U15 combmes 
for f moderate amount of gaii before driving the signal the functions of a parallel mput/output po£ a seruJ 
into CODEC U35 35 "put/output port, bus control circuitry, and a clock 

CODEC chip U3S on FIG. 8B, interface chip U34 on timer circuit in one chip. The Zilog 284C90 product 
Fia 8A and digital signal processor (DSP) chip U37 specification describes the detaied internal operettas 
on FIG 8A comprise a dam pump chip set manufac- of this circuit in the Zilog Intelligent Peripheral Con- 
ned and ^l^by AT&T Microelectronics. A detailed trailers 1991 Handbook available from Zilog, Inc. 
SSon of tne operation of these three chips in di- 40 Z84C90 CMOS Z80KIO Product specification pgs. 
rec? coition and cooperation whh one another is 205-224 of the ZUog 1991 Intelligent P^ffon- 
described in the publication entitled "AT&T trollen databook is hereby incorporated by reference^ 
v1Sris% 32/FAX High-Speed Data Pump Chip Set DaU and address buses A and B shown in FIG. 5A 
DaU, Boor ^published byAT&T Microelectronics, connect the 2801 80 -^processor -c~oller 
December 1991, which is hereby incorporated by refer- 45 U17 with the Z80 KIO circuit U15 and agate array 
cnceTTtis AT&T data pump chip set comprises the circuit U19, and to other portions of the electrical sche- 
co*T of an migrated? STwire full duplex modem matic diagrams. The gate array U19 mcludes mxscella- 
whTch L c^^^ over standard telephone neous latch and buffer circuits ; for j^g^JS 

lines or leased Unes. The data pump chip set conforms to which normally wouW be found in discrete SSI orMSI 
thTtelecommunications specifications in CCiTT rec- 50 integrated circuits. By combining a wide vanety of 
ommendatkms V.32bis, V.32, V.22bis, V.22, V.23, V.21 miscellaneous support circuits into a single gate amy, a 
aTTcompatible wtththe Bell 212A and 103 modems. much reduced design comptoaty and 
Speeds of 14400, 9600, 4800, 2400, 1200, 600 and 300 cost is achieved. A detailed description of the internal 
K sL^d^ supported- This data pump chip set operations of gate array U19 is *^_£^J 
consist of a ROM-coded DSP16A digital signal pro- 55 below in conjunction with schematic diagrams of 
cesser U37, and interface chip U34 and an AT&T FIGS. 10A-10C 

T7525 linear CODEC U35. The AT&T V.32 data pump The memory chips which operate in conj^ction 
chin set is available from AT&T Microelectronics. with the ZBO microprc^sor m microc^ntroUer chip 

ThTchip set U34, U35 and U37 on FIGS. 8A and 8B U17 are shown in FIG. 5C The connecdo^ A B cor- 
perform all A/D, D/A, modulation, demodulation and 60 respond to the connections to the ad d rem and data 
£ho cancellation of all signals placed on or taken from buses, respectively, found 0x1 FIG. 5A. Memory chips 
the tekeDhone line. The CODEC U3S performs DTMF U16 and U13 are read-only memory (ROM) chips 
^o^deStion, signaltalysis of call which are deofedy alterable in place These pre, 
progress tones, etc. The transmission of information on grammable ROMs, typically referred £ _ " 
Se^honTline from CODEC U35 is through buffer 65 PROMs or Programmable Erasable Read OnlyMemo- 
U28A, through CMOS switch U3« and through line ries (PEROMs) hold the program code and operating 
buffer UM ? The CMOS switch U3« is used to^witch parameters for the present system m a non-volatile 
bTrween the data pump chip set CODEC of circuit 310 memory. Upon power-up, the programs and operating 
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parameters are transferred to the voice control DSP The Digital Telephone CODEC chip U12 is also 
RAM U12, shown in FIG. 9B. shown in FIG. 9B which, in the preferred embodiment, 

In the preferred embodiment, RAM chip U14 is a is part number T7540 Digital Telephone CODEC man- 
pseudostatic RAM which is essentially a dynamic RAM ufactured and sold by AT&T Microelectronics, A more 
with a built-in refresh. Those skilled in the art will 5 detailed description of this telephone CODEC chip U12 
readily recognize that a wide variety memory chips is described in the T7540 Digital Telephone CODEC 
may be used and substituted for pseudo-static RAM Data Sheet and Addendum published July, 1991 by 
U14 and flash PROMs U16 and U13. AT&T Microelectronics, which is hereby incorporated 

Referring once again to FIG. 3, the main controller by reference, 
circuit 313 communicates with the voice control DSP 10 Support circuits shown on FIG. 9C are used to facili- 
of circuit 306 through dual port RAM circuit 308. The ^te communication between CODEC chip U12, 
digital telephone CODEC circuit 305, the voice control DSP/CODEC chip U8 and dual port RAM Ull. For 
DSP and CODEC circuit 306, the DSP RAM 307 and example, an 8 kHz clock is used to synchronize the 
the dual port RAM 308 are all shown in detailed electri- operation of CODEC U12 and DSP/CODEC U8. 
cal schematic diagrams of FIGS. 9A-9C. 15 " rhc operation of the dual port RAM Ull is con- 

Referring to FIG. 9A, the DSP RAM chips U6 and trolled both by DSP U8 and main controller chip U17. 
U7 are shown with associated support chips. Support dual P° rt operation allows writing into one address 

chips Ul and U2 are in the preferred embodiment part wMe reading from another address in the same chip. 
74HCT244 which are TTL-level latches used to cap- Both , processors can access the exact same memory 
ture data from the data bus and hold it for the DSP 20 ,oca tions with the use of a contention protocol such that 
RAM chips U6 and U7. Circuits U3 and U4 are also whcn one * rcadin S other cannot be writing. In the 
latch circuits for also latching address information to Preferred embodiment, dual port RAM chip Ull is part 
control DSP RAM chips U6 and U7. Once again, the number CY2C131 available from Cyprus Semiconduc- 
address bus A and data bus B shown in FIG. 9A are tcr - chip mcludes built ™ contention control so 
multi-wire connections which, for the clarity of the 25 f hat rf two processors *** t0 access s&mc memory 
drawing, are shown as a thick bus wire representing a locatlon at the time > the first °° e making the re- 
grouping of individual wires quest gets contT ° l of address location and the other 
Also in FIG. 9A, the DSP RAMs V6 and U7 are Pf 00 ^ ™ ust . wail - In preferred embodiment, a 
connected to the voice control DSP and CODEC chip ^ ^^ar biiffcr .s arranged in dual port RAM chip Ull 
U8 as shown split between FIGS. 9A and 9B. DSP/CO- 30 ^P™?* 24 bytes. By using a circular buffer configu- 
DEC chip U8 is, in the preferred embodiment, part ™*° n ^ t \ p f mtCrS mt ° thc ^« ™. both proces- 
number WE® DSP16C, digital signal processor and ^Tr^ 1 Tt™ 

CODEC chip^anufactured tnd sold by AT&T Micro- J^L^l ^1 T C °?Tl> l ° 

electronics. This is a 16-bit programmable DSP with a 35 ^^S^L™ ^S^™*™*** *f 

voice band sigma-delta CODEC orTone chip. Although 35 S^^^m^^!^^ 7 5 
tK» rnncr^-^^- -u- - ui r i * this configuration, the mam controller can download 

^^^JS^l ^ P f the control programs for DSP U8 into DSP RAMs U6 

vS^^ £ ^n^t7 T ^ * ChangCd f b , y 

coD te E l ci^ * z^^s^-si 

conic c^?4 ( T^^ control P™*™* stored m DSP c *v* Ufi ' "d U7 origi- 

CODEC circuit 305 of FIG. 3). Chip U8 includes cir- ^ m ^ flash PEROM chi U16 ^ d U17 ^ * 

S^T^^^^ 11 ' ""^g meT - routine operating on controller chtpUH 

3 ^f n^P^S??/ ? 0 !^ ^ P r0 * rammablc downloads the DSP control routines into DSP RAM 

trol of DSP/CODEC chip U8 allows it to receive digi- 45 eft™ jj 6 ajld 

t^iT* fr °° i'^f 1 ?^ * ter ? ce (through The interface between the main controller circuit 313 
tel telephone CODEC chip U12) and store ^.t ma dig,- md Ae computCT h s , 0 drcuit 3l4 
tozed form in the dual port RAM chip Ull. The digi- ^ RS232 ^ mterface 315 j^a* mterfaces ^ 
tized voice can then be passed to the mair^ controller described more fully in conjunction with the detailed 
circuit 313 where the digitized vo.ee may be transmit- 50 electrical schematic diagrams of FIG. 6A-6C. RS232 
ted to the personal computer over the RS232 circuit connection Jl is shown on FIG. 6A with the associated 
315. In a similar fashion digitized voice stored by the control circuit and interface circuitry used to generate 
main controller circuit 313 m the dual port RAM Ull and receive the appropriate RS232 standard signals for 
may be transferred through voice control DSP chip U8, a serial communications interface with a personal corn- 
converted to analog signals by telephone CODEC U12 55 puter. FIG. 6B is a detailed electrical schematic dia- 
and passed to the user. Digital telephone CODEC chip gram showing the generation of various voltages for 
U12 includes a direct telephone handset interface on the powering the hardware components of the electrical 
c "!£- schematic diagrams of hardware components 20. The 
The connections to DSP/CODEC chip U8 are power for the present hardware components is received 
shown split across FIGS. 9A and 9B. Address/data 60 on connector J5 and controlled by power switch S34. 
decode chips U9 and U10 on FIG. 9A serve to decode From this circuitry of FIG. 6B, plus and minus 12 volts, 
address and data information from the combined ad- plus five volts and minus five volts are derived for oper- 
dress/data bus for the dual port RAM chip Ull of FIG. ating the various RAM chips, controller chips and sup- 
9B. The interconnection of the DSP/CODEC chip U8 port circuitry of the present system. FIG. 6C shows the 
shown on FIGS. 9A and 9B is described more fully in 65 interconnection of the status LED's found on the front 
the WE ® DSP1 6C Digital Signal Processor/CODEC display of the box 20. 

Data Sheet published May, 1991 by AT&T Microetec- Finally, the "glue logic" used to support various 

tronics, which is hereby incorporated by reference. functions in the hardware components 20 are described 
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Table 2 shows the three basic types of packets with the 
sub-types listed. 

TABLE 1 

Packet Parameter* 



10 



1. Asynchronous transfer 

2. 8 bits, no parity 

3. Maximum packet length of 128 bytes 

- IDentifier byte = 1 
. Information = 127 

4. SPEED 

- variable from 9600 to 57600 
-default to 19200 



TABLE 2 



Packet Types 



25 



1. Data 

2. Voice 

J. Qualified: 

a. COMMAND 

b. RESPONSE 
C. STATUS 

d. FLOW CONTROL 

e. BREAK 
r. ACK 
&.NAK 

h. STREAM 



in conjunction with the detailed electrical schematic 
diagrams of FIGS. 10A-10C. The connections between 
FIGS. I0A and 10C and the previous schematic dia- 
grams is made via the labels for each of the lines. For 
example, the LED status lights are controlled and held 
active by direct addressing and data control of latches 
GA1 and GA2. For a more detailed description of the 
connection of the glue logic of FIGS. 10A-10C, the 
gate array U19 is shown connected in FIGS. 5A and 5B. 

Packet Protocol Between the PC and the Hardware 
Component 

A special packet protocol is used for communication 
between the hardware components 20 and the personal 
computer (PC) 10. The protocol is used for transferring 15 
different types of information between the two devices 
such as the transfer of DATA, VOICE, and QUALI- 
FIED information. The protocol also uses the BREAK 
as defined in CCITT X.28 as a means to maintain proto- 
col synchronization. A description of this BREAK 20 
sequence is also described in the Statutory Invention 
Registration entitled "ESCAPE METHODS FOR 
MODEM COMMUNICATIONS**, to Timothy D. 
Gunn filed Jan. 8, 1993, which is hereby incorporated 
by reference. 

The protocol has two modes of operation. One mode 
is packet mode and the other is stream mode. The proto- 
col allows mixing of different types of information into 

the data stream without having to physically switch A Data Packet is shown in Table 1 and ts used for 
modes of operation. The hardware component 20 win 30 normal data transfer between the controller 313 of hard- 
identify the packet received from the computer 10 and ware component 20 and the computer 10 for such things 
perform the appropriate action according to the specifi- 35 text, file transfers, binary data and any other type of 
cations of the protocol. If it is a data packet, then the information presently being sent through modems. All 
controller 313 of hardware component 20 would send it packet transfers begin with a synch character 01 hex 
to the data pump circuit 31L If the packet is a voice 35 Synchronization byte). The Data Packet begins with an 
packet, then the controller 313 of hardware component ^ 1 — _ ...t.:-u »v.» nortot t™* »nd nacket 

20 would distribute that information to the Voice DSP 
306. This packet transfer mechanism also works in the 

reverse, where the controller 313 of har dware compo- — ^ ^ fi of a ^ Packet 

nent 20 would give different .formation to the com- 40 «*u P f ^ ^ ^ ^ ^ 

puter 10 without having to switch into different modes. 
The packet protocol also allows commands to be sent to 
either the main controller 313 directly or to the Voice 
DSP 306 for controlling different options without hav- 
ing to enter a command state. 

Packet mode is made up of 8 bit asynchronous data 
and is identified by a beginning synchronization charac- 
ter (01 hex) followed by an ID/LI character and then 
followed by the information to be sent. In addition to 
the ID/LI character codes defined below, those skilled 50 
in the art will readily recognize that other ED/LI char- 
acter codes could be defined to allow for additional 
types of packets such as video data, or alternate voice 
compression algorithm packets such as Codebook Ex- 
cited Linear Predictive Coding (CELP) algorithm, 55 
GSM, RFE, VSELP, etc. 

Stream mode is used when large amounts of one type 
of packet (VOICE, DATA, or QUALIFIED) is being 
sent. The transmitter tells the receiver to enter stream 
mode by a unique command Thereafter, the transmitter 60 
tells the receiver to terminate stream mode by using the 
BREAK command followed by an "AT" type com- 
mand. The command used to terminate the stream mode 
can be a command to enter another type of stream mode 
or it can be a command to enter back into packet mode. 65 

Currently there are 3 types of packets used: DATA, 
VOICE, and QUALIFIED. Table 1 shows the com- 
mon packet parameters used for all three packet types. 
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ID byte which specifies the packet type and packet 
length. Table 3 describes the Data Packet byte structure 
and Table 4 describes the bit structure of the ID byte of 
the Data Packet. Table 5 is an example of a Data Packet 
with a byte length of 6. The value of the LI field is the 
actual Length of the data field to follow, not counting 
the ID byte. 

TABLE 3 



Data Packet Byte Structure 



byte 1 1 
byte 2 > 
bytes 3-127 ■■ 



01 h (sync byte) 

ID /LI (ID byte/lcnjth iodic 

data (depending on LI) 



itor) 



01 


ID 


SYNC 


LI 



data I data data 



data 



data 



TABLE 4 
ID Byte of Data Packet 



Bit 7 identifies the type of packet 
Bits 6-0 contain the LI or length indicator 
portion of the ID byte 

7 6 3 4 ^3 2 L _0 



LI 



. 1 I I 

(^ecgyh Indicator) = 1 to ^127 



TABLE 5 



Data Packet Example 



LI (length indicator) = 6 
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TABLE 9 





Data Packet Example 






Qualifier Packet Byte Structnre 








||sYNC 


| ID 1 data | data 


data 1 data 


data {jdata 


| || SYNC 


85 II QUAL 
||ID || BYTE 


data || data ||data | 


|| data 



10 



The Voice Packet is used to transfer compressed 
VOICE messages between the controller 313 of hard- 
ware component 20 and the computer 10. The Voice 
Packet is similar to the Data Packet except for its length 
which is, in the preferred embodiment, currently fixed 
at 23 bytes of data. Once again, all packets begin with a IS 
synchronization character chosen in the preferred em- 
bodiment to be 01 hex (01H). The ID byte of the Voice 
Packet is completely a zero byte: all bits are set to zero. 
Table 6 shows the ID byte of the Voice Packet and ^ 
Table 7 shows the Voice Packet byte structure. 

TABLE 6 



IP Byte of Voice Packet 



3 4 3 2 I P 
I I I I I 
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The bit maps of the Qualifier Byte (QUAL BYTE) of 
the Qualified Packet are shown in Tables 10-12. The bit 
map follows the pattern whereby if the QUAL byte=0, 
then the command is a break. Also, bit 1 of the QUAL 
byte designates ack/nak, bit 2 designates flow control 
and bit 6 designates stream mode command. Table 10 
describes the Qualifier Byte of Qualified Packet, Group 
1 which are immediate commands. Table 1 1 describes 
the Qualifier Byte of Qualified Packet, Group 2 which 
are stream mode commands in that the command is to 
stay m the designated mode until a BREAK -t-INIT 
command string is sent. Table 12 describes the Qualifier 
Byte of Qualified Packet, Group 3 which are informa- 
tion or status commands. 

TABLE 10 

Qualifier Byte of Qualified Packet; Orouo 1 



LI (Length Indicatorj = 0 



TABLE 7 



30 



Voice Packet Byte Structure 



U (length indicator) = 0 
23 bytes of data 



0i 
SYNC 



00 






ID 


data 


data 



data data data 
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data 



The Qualified Packet is used to transfer commands 40 
and other non-data/voice related information between 
the controller 313 of hardware component 20 and the 
computer 10. The various species or types of the Quali- 
fied Packets are described below and are listed above in 45 
Table 2. Once again, all packets start with a synchroni- 
zation character chosen in the preferred embodiment to 
be 01 hex (01H). A Qualified Packet starts with two 
bytes where the first byte is the ID byte and the second 
byte is the QUALIFIER type identifier. Table 8 shows 
the ID byte for the Qualified Packet, Table 9 shows the 
byte structure of the Qualified Packet and Tables 10-12 
list the Qualifier Type byte bit maps for the three types 
of Qualified Packets. 

TABLE 8 



7 


6 


5 


4 


3 


2 


1 


0 




X 


X 


X 


X 


X 


X 


X 


X 




0 


0 


0 


O 


0 


0 


0 


0 


= break 


0 


0 


0 


0 


0 


0 


1 


0 


= ACK 


0 


0 


0 


0 


0 


0 


1 


1 


= NAX 


0 


0 


0 


0 


0 


1 


0 


0 


= xofT or stop sending data 


0 


0 


0 


0 


0 


] 


0 


J 


— xon or res nine sending 


















data 


0 


0 


0 


0 


1 


0 


0 


0 


~ cancel fax 


TABLE 1 1 








Qualifier 


Byte of Qualified Packet: Grotro 2 


1 


6 


5 


4 


3 


2 


1 


0 




X 


X 


X 


X 


X 


X 


X 


X 




0 


1 


0 


O 


O 


0 


0 


1 


= stream command mode 


0 


1 


0 


0 


0 


0 


1 


0 


*- stream data 


0 


I 


0 


0 


0 


0 


1 


t 


— stream voice 


0 


1 


0 


0 


0 


1 


0 


0 


= stream video 


0 


I 


0 


0 


0 


1 


0 


1 


— stream A 


0 


1 


0 


0 


0 


1 


1 


0 


— stream B 


0 


1 


0 


0 


0 


1 


1 


I 


= stream C 



50 



55 



ID Byte of Qualified Packet 



The Qualifier Packet indicating stream mode and 
BREAK attention is used when a large of amount of 
information is sent (voice, data . . . ) to allow the highest 
throughput possible. This command is mainly intended 
for use in DATA mode but can be used in any one of the 
possible modes. To change from one mode to another, a 
break-mit sequence would be given. A break "AT . . . 
<cr>" type command would cause a change in state 
and set the serial rate from the "AT" command. 

TABLE 12 

Qualifier Byte of Qualified Packet: Group 3 



V i V i vr 

LI ^Lemyh Indicator) = 1 to 171 



60 



7 6 


5 


4 


3 


2 


I 


0 




X X 


I 


X 


X 


X 


X 


X 




1 0 


0 


0 


0 


0 


0 


0 




1 0 


0 


0 


0 


0 


0 


t 


= responses 


1 0 


0 


0 


0 


0 


1 


0 


= status 



The Length Identifier of the ID byte equals the 
amount of data which follows including the QUALI- 
FIER byte (QUAL byte+DATA). If U=l, then the 
Qualifier Packet contains the Q byte only. 



Cellular Supervisory Packet 

In order to determine the status of the cellular link, a 
supervisory packet shown in Table 13 is used. Both 
sides of the cellular link will send the cellular supervi- 
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sory packet every 3 seconds. Upon receiving the cellu- conventional data transmission. A silence detection 
lar supervisory packet, the receiving side will acknowl- function is used to detect quiet intervals in the speech 
edge it using the ACK field of the cellular supervisory signal and substitute conventional data packets in lieu of 
packet. If the sender does not receive an acknowledge- voice data packets to effectively time multiplex the 
ment within one second, it will repeat sending the cellu- 5 voice and data transmission. The allocation of time for 
lar supervisory packet up to 12 times. After 12 attempts conventional data transmission is constantly changing 
of sending the cellular supervisory packet without an depending upon how much silence is on the voice chan- 
acknowledgement, the sender will disconnect the line. ne l. 

Upon receiving an acknowledgement, the sender will The voice compression algorithm of the present sys- 
restart its 3 second timer. Those skilled in the art will ID tem relies on a model of human speech which shows 
readily recognize that the timer values and wait times t hat human speech contains redundancy inherent in the 
selected here may be varied without departing from the voice patterns. Only the incremental innovations 
spirit or scope of the present invention. (changes) need to be transmitted. The algorithm oper- 

TABLE 13 ates on 160 digitized speech samples (20 milliseconds), 

Supcrvtsory Structure 15 divides the speech samples into time segments °f 5 mUU- 

^ — seconds each, and uses predictive coding on each seg- 

8F id L i ACK d»a da» 2± — ment. with this algorithm, the current segment is pre- 
dicted as best as possible based on the past recreated 

„ . « segments and a difference signal is determined. The 

Speech Compression 20 diffcrencc value ^ compared to the stored difference 

The Speech Compression algorithm described above values in a lookup table or code book, and the address of 
for use in the voice mail function, the multimedia mail ^ dosest value is sent to the remote site along with the 
function and the show and tell function of the present predicted gain and pitch values for each segment. In this 
system is all accomplished via the voice control circuit fashion, four 5 ms speech segments can be reduced to a 
306. Referring once again to FIG. 3, the user is talking 25 packet of 23 bytes or 154 ^ (4© bits per sample seg- 
either through the handset, the headset or the micro- ment ). By transmitting 184 bits every 20 milliseconds, 
phone/speaker telephone interface. The analog voice m efrective xriai data transmission rate of 9200 bps is 
signals are received and digitized by the telephone accomplished. 

CODEC circuit 305. The digitized voice information is Tq producc this compression, the present system 
passed from the digital telephone CODEC circuit 305 30 a Vector Quantization (VQ) speech 

to the voice control circuits 306. The digital signal compression algorithm designed to provide maximum 
processor (DSP) of the voice control circuit 306 is pro- M ^ minnnum compute power and bandwidth, 
grammed to do the voice compression algorithm^ The ^ algorithm has two major components. The first 
source code prograrruned into the voiceconuol DSP is rcduces ^ dynamic range of the input speech 

attached in the microfiche appendix. The DSP of the 35 removing short term and long term redundan- 

voice control circuit 306 compresses the speech and d ^ ^ fe done in the waveform domain, 

places the compressed digital representations of the synthesized part used as the reference for de- 

speech into special packets described more My bek»£ Znning the incremental "new" content The second 
As a result of the voice „ section maps the residual signal into a code book opti- 

compresscd voice information is passed to the dual, port 40 preserving the general spectral shape of the 

ram circuit 308 for either forwarding and storage on the , . a 

disk of the personal computer via the R^2 ser^inter- *g level 5ignaI now block diagram of 

face or for mul^lexmg with convenUonal modem daU compression algorithm used in the present 

to be transmitted over the telephone line via the tele- compress the digitized voice for transmission 

phone Une interface circutt 309 ■ ^ v™er-data 45 system to £J££ m^oice over data mode of 
mode of operation Show and Tell function 123). opemion o / f0r storage and use on the personal com- 

Speech Compression Algorithm puter. The transmitter and receiver components are 

To multiplex high-fidelity speecb with digital data ^^^C^tllSSS^G^ ^ 
and transmit both over the over the telephone line, a 50 D ^^*^^ no7 re cew2 L digitized 
high available bandwidth would normally be required. The DC ^valsteg £ "^^^^g^ 
Into present invention, the analog vo.ee information is speech signal and renwves the D.C. by ^ulanng 

^SShrixf sscssr r^-ffl[;ap!i fc ,ow h 

S^mODSP such Xt the compressed speech The system finds the innovation uv the current speech 

^^tS^^^^t^^ Une using a 9600 60 segment by subtracting 1109 the predion fr^recon- 

Sud modem transmission. This is an approximately 7 to structed past samples synthesized from synthes* stage 

orTcomtrL^rrSo This is accomplished in an effi- U07. This process requires the synthes,s of the past 

c^t^an^cnThtt enough machine cycles remain speech samples locally (analysis by synthesis). The syn- 

Sg3^me speech compassion to allow real time thesis block 1107 at ^^""^f™ *™ 

acoustic and line^o cancellation in the same fixed- 65 function as the synthesis block 1113 at the receiver 

noint DSP When the reconstructed previous segment of speech is 

Even at 9200 bps serial data rate for voice data trans- subtracted from the present segment (before predic- 

mission this bit rate leaves little room for concurrent tion), a difference term is produced in the Form of an 
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error signal. This residual error is used to find the best signal for analysis by synthesis and for the output to 

match in the code book 1105. The code book 1105 quan- the reconstruction stage below, 

tizes the error signal using a code book generated from f) Use a de-emphasis filter to reconstruct the output, 

a representative set of speakers and environments. A The major advantages of this approach over other 

minimum mean squared error match is determined in 5 5 low-bit-rate algorithms are that there is no need for any 

ms segments. In addition, the code book is designed to complicated calculation of reflection coefficients (no 

provide a quantization error with spectral rolloff matrix inverse or lattice filter computations). Also, the 

(higher quantization error for low frequencies and quantization noise in the output speech is hidden under 

lower quantization error for higher frequencies). Thus, the speech signal and there are no pitch tracking arti- 

the quantization noise spectrum in the reconstructed 10 facts: the speech sounds "natural", with only minor 

signal will always tend to be smaller than the underly- increases of background hiss at lower bit-rates. The 

ing speech signal. computational load is reduced significantly compared 

The channel corresponds to the telephone line in 10 a VSELP algorithm and variations of the same algo- 

which the compressed speech bits are multiplexed with rithm provide bit rates of 8, 9.2 and 16 Kbit/s. The total 

data bits using a packet format described below. The 15 delay through the analysis section is less than 20 milli- 

voice bits are sent in 100 ms packets of 5 frames each, seconds in the preferred embodiment The present algo- 

each frame corresponding to 20 ms of speech in 160 rithm is accomplished completely in the waveform 

samples. Each frame of 20 ms is further divided into 4 domain and there is no spectral information being com- 

sub-blocks or segments of 5 ms each. In each sub-block P uted 31,(1 thcrc «s no filter computations needed. 

f^^S^^ 1 ^^^^"?^ 20 DMd ofthe Speech Compression 

3 bits for the long term predictor gam, 4 bits for the Algorithm 
sub-block gain, and 32 bits for each code book entry for 

a total 46 bits each 5 ms. The 32 bits for code book e s P ecch compression algorithm is described in 

entries consists of four 8-bit table entries in a 256 long g^ier detail with reference to FIGS. 11 through 13, 
code book of 1.25 ms duration. In the code book block, 25 ^ ^ reference to the block diagram of the hard- 
each 1.25 ms of speech is looked up in a 256 word code ware components of Ae present system shown at FIG. 
book for the best match. The 8-bit table entry is trans- * AJs ° t ^22? * made to the detailed thematic 
mitted rather than the actual samples. The code book d,agr L ams m nGS 9A_9C The voice compression al- 
entries are pre-computed from representative speech „ g ° nthm programmed control of the 

segments. (See the DSP Source Code in the imcrofiche 30 VOTCC f° ntTO ! DSP C f CU,t 306 In °r*raUon, the speech 
appendix.) or anaJog volce ^S™* » received through the telephone 

On the receiving end 1200, the synthesis block 1113 at t^^^^^^^l^ ^ 
the receiver performs the same function as the synthesis £? >hone circ , ult ^I5l C 2? EC for circuit 

block 1107 althe transmitter. The synthesis blcS 1113 „ a "JT .7 T ?3 ^° fi ^ 

reconstructs the original signal from the voice data 35 JS?? £ e ^one mterface is band-limited to 

-pi _ t1 . , , . . ' 40 DEC of circuit 306. There, the 8-bit ix-law PCM data is 

^^^^^t^T^^ ^ to 13 - Wt linear PCM data. Hu, 13-bit repre- 

r e P nr^n^^^ T P "f S -^T, ^ sentatk,n » neccss ^ * accurately represent the linear 
^cn P n^ P i^,T. by rCSt ° nng thC balanCe ° f version of the logarithmic 8-bit ^aw PCM data. With 
-S^infTS !£L , . linear PCM data, simpler mathematics may be per- 

The complete speech compression algonthm is sum- 45 formed on the PCM ^ ^ 

"Xw^n^^Tn c w« • a u - , The voice control DSP/CODEC of circuit 306 cor- 
M ^ZCLT P ™J SPCeCh S,Snfll - ^pond to the single integrated circuit U8 shown in 
} £^£ P ^ * ^"t . mGS ' »A and 9B as a WE ® DSP16C Digital Signal 
k u*^ innovation in the current speech segment Processor/CODEC from AT&T Microelectronics 
by subtracting the prediction from reconstructed 50 which is a combined digital signal processor and a linear 
past samples. This step requires the synthesis of the CODEC in a single chip as described above. The digital 
past speech samples locally (analysis by synthesis) telephone CODEC of circuit 305 corresponds to inte- 
such that the residual error is fed back into the grated circuit U12 shown in FIG. 9(b) as a T7540 corn- 
system. ... panding ji-law CODEC. 

d) Quantize the error signal using a code book gener- 55 The sampled and digitized PCM voice signals from 
ated from a representative set of speakers and envi- the telephone ^i-law CODEC UU shown in FIG. 9B 
ronments. A minimum mean squared error match is are passed to the voice control DSP/CODEC VB via 
determined m 5 ms segments. In addition, the code direct data lines clocked and synchronized to an 8 KHz 
book is designed to provide a quantization error clocking frequency. The digital samples are loaded into 
with spectral rolloff (higher quantization error for 60 the voice control DSP/CODEC U8 one at a time 
tow frequencies and lower quantization error for through the serial input and stored into an internal 
higher frequencies). Thus, the quantization noise queue held in RAM and converted to linear PCM data, 
spectrum in the reconstructed signal will always As the samples are loaded into the end of the queue in 
tend to be smaller than the underlying speech sig- the RAM of the voice control DSP U8, the samples at 

. "f 1 * 65 the head of the queue are operated upon by the voice 

e) At the transmitter and the receiver, reconstruct the compression algorithm. The voice compression al go- 
speech from the quantized error signal fed into the rithm then produces a greatly compressed representa- 
inverse of the function in step c above. Use this tion of the speech signals in a digital packet form. The 
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compressed speech signal packets are then passed to the 1 60 samples are accumulated in the queue of the internal 

dual port RAM circuit 308 shown in FIG. 3 for use by DSP RAM, the compression of that sample frame is 

the main controller circuit 313 for either transferring in begun. 

the voice-over-data mode of operation or for transfer to The voice-control DSP/CODEC circuit 306 is prc- 

the personal computer for storage as compressed voice 5 grammed to first remove the DC component 1101 of the 

for functions such as telephone answering machine incoming speech. The DC removal is an adaptive func- 

message data, for use in the multi-media documents and tion to establish a center base line on the voice signal by 

the like. digitally adjusting the values of the PCM data. The 

In the voice-over-data mode of operation, voice con- formula for removal of the DC bias or drift is as follows: 

trol DSP/CODEC circuit 306 of FIG. 3 will be receiv- 10 
ing digital voice PCM data from the digital telephone 

CODEC circuit 305, compressing it and transferring it 32735 

to dual port RAM circuit 308 for multiplexing and S(n) = M.n) - *<* - l) + « * - •) * herea ° 32768 
transfer over the telephone line. This is the transmit 

mode of operation of the voice control DSP/CODEC 15 Tne remova l of the DC is for the 20 millisecond 

circuit 306 corresponding to transmitter block 1100 of f rame Q f voice which amounts to 160 samples. The 

FIG. 11 and corresponding to the compression algo- selection of a is based on empirical observation to pro- 

rithm of FIG. 12. vu ^ e tne best result. 

Concurrent with this transmit operation, the voice Referring to FIG. 12, the voice compression al go- 
control DSP/CODEC circuit 306 is receiving com- 20 rilhm fa a fl ow diagram is shown which will 
pressed voice data packets from dual port RAM circuit m the u^^tanding of the block diagram of FIG. 
308, uncompressing the voice data and transferring the n ^ ^ compression begin at block 1201 
uncompressed and recomtruc^ digitaJ PCM voice whefe |he ^ bit lincar PCM specch samples are accu- 
data to the digital telephone CODEC 305 for digital to ^ ^ ^ repnscn ting 20 milliseconds 
analog conversion and ev^^nsfer user 25 Qr Qnc framc of voicc * p^sed to the DC 
through the telephone interface 301, . ™b» operating within the pro- 
° f t ^iZ^^Zfa^t grammed^ice control DSP/CODEC circuit 306. The 

pr^^gon™- "HO. 13 Xs the voice^ontrol 30 proxbnates the base line of the frame of voice by usxng 

Kc^rnnFC circuit 306 is orocessine the voice data an adaptive DC removal technique. 

SLtSS A ,„ence detection ^^^^Z 

The voice control DSP/CODEC circuit 306 operates the programmed code of the DSP/CODEC 306. i ne 

at a clock frequency of approximately 24.576 MHz silence detection function is a summation of the square 

whue pToceSSg daL at Sampling rais of appro*- 35 of each sample of the voice signal over the frame If the 

mately 8 KHz in both directions. The voice compres- power of the voice frame falls below a Prelected 

sion/decompression algorithms and packetization of the threshold, this would radicate a silent frame. The detec- 

voice data is accomplished in a quick and efficient fash- tion of a silence frame of speech is important for later 

ion to ensure that all processing is done in real-time multiplexing of the V-data and C-data described below, 

without loss of voice information. This is accomplished 40 During silent portions of the speech, the main controller 

in an efficient manner such that enough machine cycles circuit 313 will transfer conventional digital data (C- 

remain in the voice control DSP circuit 306 during real data) over the telephone line in lieu of voice data (V- 

time speech compression to allow real time acoustic and data). The formula for computing the power is 
line echo cancellation in the same fiied-point DSP. 

In programmed operation, the availability of an eight- 45 )K) _ 1 

bit sample of PCM voice data from the ^t-law digital pwr = z q sw *m 
telephone CODEC circuit 305 causes an interrupt in the 

voice control DSP/CODEC circuit 306 where the powcr PW R is lower than a preselected thresh- 
sample is loaded into internal regist^ for proc^ng^ ^ t voicc franie fa flagged as contain- 
Once loaded into an internal register it * ^medtc- 50 ' ^ T w 15> ^ 160 -sam P le silent frame 
a RAM address which holds a queue of samples The ^ g ^ rocessed by ^ ^ compression algorithm; 
queued PCM «^ ™™^ ft £?e howeve^Tsllent frame packets are discarded by the 
8-bit u-Uw data to a 13-b.t ^ stroller circuit 313. that digital data may be 
lookup for the conversion. Those skilled in the art will ,uail " ' . . _ 
readUv recognize that the digital telephone CODEC 55 transferred in lieu of voice data, 
SSt 3S33?JSTb« alinL CODEC. The rest of the voice ^^^T^^Z 
Referring to FIG. 11, the digital samples are shown as segments where there are four segments per frame 
speech Sg the transmitter block 1100. The trans- amounting to 40 samples of data per segment. It is only 
Sbtock, of course, is the mode of operation of the the DC removal and silence detection which aaccom- 
voice-control DSP/CODEC circuit 306 operating to 60 pushed over an entire 20 millisecond frame. The pre- 
receive local digitized voice information, compress it emphasis 1207 of the voice compression algorithm 
and packetize it for transfer to the main controller cir- shown in FIG. 12 is the next step. The formula for the 
cuit 313 for transmission on the telephone line. The prc-emphasts is 
telephone line connected to telephone line interface 309 

of FIG. 3 corresponds to the channel 1111 of FIG. 11. 65 f so,- 0 where r=o,55 

A frame rate for the voice compression algorithm is 

20 milSetonds of speech for each compression. This Each segment thus amounts to fiv^lhseconds of 

correlates to 160 samples to process per frame. When voice which is equal to 40 samples. Pre-emphasis then is 
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done on each segment. The selection of r is based on 

empirical observation to provide the best result Sxy{ p i 

The pre-emphasis essentially flattens the signal by fixgmca = -SxxW 
reducing the dynamic range of the signal. By using 

pre-emphasis to flatten the dynamic range of the signal, 5 where Sxx = % S 2q + MAX _ PIT CH - besi_pitch) 

less of a signal range is required for compression making ,a ° 
the compression algorithm operate more efficiently. 

The next step in the speech compression algorithm is The value of the LTP factor £ * a normalized 

the long-term predictor (LTP). The long-term predic- ^tity between zero and unity for this segment where 

lion is a method to detect the innovation in the voice 10 ^ " an indicator of the correlation between the seg- 

signal. Since the voice signal contains many redundant mentSt For exam P le * a perfect sine wave would produce 

voice segments, we can detect these redundancies and a & wMch would closc t0 unit y the correlation 

only send information about the changes in the signal tetvseen the currcnt segments and the previous recon- 

from one segment to the next This is accomplished by s ^ t ^ segmc J nts shouId * dmost » P*rf** ^ch so 

comparing the linear PCM data of the current segment 15 J^Jf^J^Tl" ^ t ^, , ™ ^ - 

on a sample by sample basis to the reconstructed linear T T? e i^? 8 *" 1 factor * ^ a ^ TP Gain 

PCM data from the previous segments to obtain the Tabk ' ^ ^ * charactenzed 10 TaWe 14 

innovation information and an indicator of the error in TABLE 14 



the prediction. LTP Gain Qmnazaoon 
The first step in the long term prediction is to predict ■ 03 os 07 a* 



predict the gain of the pitch. For each segment of 40 — — ^ 0=2 0=3 0=4 0=5 

samples, a long-term correlation lag PITCH and associ- 
ated LTP gain factor £y (where j =0, 1, 2, 3 correspond- 25 gain value of $ is then selected from this table 
ing to each of the four segments of the frame) are deter- depending upon which zone or range Pugmtnt was found 
mined at 1209 and 121 1, respectively. The computations ^ de P icled in Table 14. For example, if fr^mem equal to 
are done as follows. 0-45, then 0 is selected to be 2. This technique quantizes 

From MINIMUM PITCH (40) to MAXIMUM the ^ mto a ^ Ut quantity- 
PITCH (120) for indices 40 through 120 (the pitch val- 30 Ne ? t * LTP Term Predictor) filter function 
ues for the range of previous speech viewed), the voice 1213 * com P«ted. The pitch value computed above is 
control DSP circuit 306 computes the cross correlation ***** to P^ 0 ™ the long-term analysis filtering to cre- 
between the current speech segment and the previous ate 9X1 erTOr ngnal e(n). The normalized error signals 
speech segment by comparing the samples of the cur- w ? 1 tr^sautted to the other site as an indicator of the 
rent speech segment against the reconstructed speech 35 origina3 si &nal on a per sample basis. The filter function 
samples of the previous speech segment using the fol- for the curTent segment is as follows: 
lowing formula: 

€(a)=S(n)-0» S(n— pitch) where n=0 r 1 39 

Next, the code book search and vector quantization 
Sxyif) = 2 s(n k + i>* ?(n k + i -j) 40 fun ction 1215 is performed. First, the voice control 

' =0 DSP circuit 306 computes the maximum sample value 

in the segment with the formula: 

where 

j=40, ... 120 GA1N = MAX { | e(n> |}wherc u-0, 1 39 

S= current sample of current segment 45 

S'=past sample of reconstructed previous segment This gain different than the LTP gain. This gain is the 

n*=0, 40, 80, 120 (the subframe index) maximum amplitude in the segment This gain is quan- 

and where the best fit is tized using the GAIN table described in the DSP 

Source Code attached in the microfiche appendix. Next, 
Sxy = max (SxyV)} where/ .= 40, 120. 50 me voice control DSP circuit 306 normalizes the LTP 

filtered speech by the quantized GAIN value by using 
The value of j for which the peak occurs is the ^ majdmum error |e(n)| (absolute value for 

PITCH. This is a 7 bit value for the current segment ^ for the current sc « ment and dividing this into 
calculated at 1209. The value of j is an indicator of the « 5 CVCry Sa f Dple m th£ ^S™^ 1 to normalize the samples 
delay or lag at which the cross correlation matches the across the entire segment. Thus the e(n) values are all 
best between the past reconstructed segment and the n °™*}™* to have values between zero and one using 
current segment This indicates the pitch of the voice in following: 
the current frame. The maximum computed value of j is *(n)=*<nyoAiN n=0 39 

used to reduce the redundancy of the new segment 60 

^^^^r e ^r t0 ^ WlC ^ dSCemaiUi " tbC , Each segment of 40 samples is comprised of four 
present algorithm since the value of j is a measure of subsegments of 10 samples each. The voice control 
how close the current segment is to the previous recon- DSP circuit 306 quantizes 10 samples of e(n> with an 
structed segments. ind „ into the code book. The code book consists of 256 

_ Jl cxt \ the . control DSP circuit 306 computes the 65 entries (256 addresses) with each code book entry con- 
LTP gain factor p at 1211 using the following formula sisting of ten sample values. Every entry of 10 samples 
in which Sxy is the current segment and Sxx is the in the code book is compared to the 10 samples of each 
previous reconstructed segment: subsegment. Thus, for each subsegment, the code book 
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address or index is chosen based on a best match be- algorithm to prevent feedback from destroying the 
tween the 10-sample subsegment and the closest 10-sam- voice signals. In addition, a line echo cancellation algo- 
ple code book entry. The index chosen has the least rithm is needed no matter which telephone interface 
difference according to the following minimization 301, 302 or 303/304 is used. The echo cancellation algo- 
fonnula: 3 rithm used is an adaptive echo cancder which operates 

in any of the modes of operation of the present system 
whenever the telephone interface is operational. In 
f l<>£ I _ particular the echo canceller is operational in a straight 

10 V «=0 ' / telephone connection and it is operational in the voice- 

10 over-date mode of operation, 
where In the case of a straight telephone voice connection 

x,=the input vector of 10 samples, and between the telephone interface 301, 302, 303/304 and 

yi=thc code book vector of 10 samples the telephone line interface 309 in communication with 

This comparison to find the best match between the m atl ^ os telephone on the other end, the digitized 
subsegment and the code book entries is computation- 15 voicc f rom digital telephone CODEC 303 is 

ally intensive, A brute force comparison may exceed transferred through the voice control DSP/CODEC 
the available machine cycles if real time processing is to circuit 3^ where it is processed in the digital domain 
be accomplished. Thus, some shorthand processing ^ convcrte(i back from a digital form to an analog 
approaches are taken to reduce the computations re- form . the mterna l ii nea r CODEC of voice-control 
quired to find the best fit. The above formula can be 20 DSP/CODEC circuit 306. Since digital telephone 
computed in a shorthand fashion by precomputing and CODEC circuit 305 is a u-law CODEC and the internal 
storing some of the values oT this equatton^Fbr exanv voice-control DSP/CODEC circuit 

pie, by expanding out the above formuK someofthe CODEC a ^-law-to-Iinear conversion 

unnecessary terms may be removed and some fixed ^^bed by the voice control DSP/CO- 

terms may be precompiled: 25 ^ ^ 

In addition, the sampling rate of digital telephone 
= (xi-ri'to-jd CODEC 305 is slightly less than the sampling rate of the 

linear CODEC of voice control DSP/CODEC circuit 
= {x, 2 — xffi — *qh + yr) 30 306 so a slight sampling conversion must also be accom- 

= <x, 3 - Um + >ft plished. The sampling rate of digital telephone ji-law 

CODEC 305 is 8000 samples per second and the sam- 
where is a constant so it may be dropped from the p ii ng rate of the linear CODEC of voice control 
formula, and where the value of i 2 y? may be pre- DSP/CODEC circuit 306 is 8192 samples per second, 
computed and stored as the eleventh value in the code 35 Referring to FIG. 14 in conjunction with FIG. 3, the 
book so that the only real-time computation involved is spe ech or analog voice signal is received through the 
the following formula: telephone interface 301, 302 or 303 and is digitized by 

the digital telephone CODEC circuit 305 in an analog 
to digital conversion 1401. The CODEC for circuit 305 
Mtaf l °2 ' fcw 40 * a companding u.-law CODEC. The analog voice 

V '=0 ) signal f rom the telephone interface is band-limited to 

about 3,500 Hz and sampled at 8 kHz with each sample 
Thus, for a segment of 40 samples, we will transmit 4 encoded mt o 8-bit PCM data producing a serial 64kb/s 
code book indexes corresponding to 4 subsegments of signal ^ digitized samples are passed to the voice 
10 samples each. After the appropriate index into the 45 D SP of circuit 306 where they are immediately 

code book is chosen, the LTP filtered speech samp es convened to l3 ^ it linear PCM samples, 
are replaced with the code book samples. These samples Referring again to FIG. 14, the PCM digital voice 
are then multiplied by the quantized GAIN in block ^ y(n) from ^^0^ CODEC circuit 305 is passed 

1217 , • to the voice control DSP/CODEC circuit 306 where 

Next, the inverse of the LTP filter function ,s com- 50 ^ y(n) m the form of digital data 

puted at 1219: fe subtracte d from it. The substractkm is done on each 

44- S{*-pitcK)* -o, . . . , » sample on a per sample basis. 

* ' Blocks 1405 and 1421 are gain control blocks g m and 

5-(0-5-(n)n=*o. ... 120; f-o, . . . (12O-40) g^, respectfully. These digital gain controls are derived 

from tables for which the gain of the signal may be set 
5-(0=f </)t=a ... « to different levels depending upon the desired level for 

the voice signal. These gain levels can be set by the user 
The voice is reconstructed at the receiving end ot the (hr h ^ level controls in the software as shown in 
voice-over-data link according to the reverse of the The on the digitized signal is set by multi- 

compression algorithm £ shown as the decomr^ession 60 to each of the linear PCM samples, 

algorithm in FIG. 13. ^V""^™^*^ ? Tan alternate embodiment, the gain control blocks 
performed in the compression algorithm of F1G^12 . controlled by sensing the level of the 

since the past segment must be synthesized to predict ^^^^^ITalcordingly. This 
the gain and pitch of the current segment & ^^JSJ^ operation of the 

Echo Cancellation Algorithm silence detection described above to assist in the time 

The use of the speaker 304 and the microphone 303 allocation between multiplexed data and voice in the 
necessitates the use of an acoustical echo cancellation voice over data mode of operation. 
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In voice over data mode, the output of gain control 
block is placed in a buffer for the voice compres- 
sion/decompression algorithm 1425 instead of sample 
rate converter 1407. The samples in this mode are accu- 
mulated, as described above, and compressed for multi- 
plexing and transmission by the main controller 313. 
Also in voice over data mode, the gain control block 
1421 receives decompressed samples from the voice 
compression/decompression algorithm 1425 instead of 
sample rate converter 1423 for output. 

The echo cancel cr of FIG. 14 uses a least mean 
square (LMS) method of adaptive echo cancellation. 
The echo estimate signal subtracted from the incoming 
signal at 1403 is determined by function 1411. Function 
1411 is a an FIR (finite impulse response) filter having in 
the preferred embodiment an impulse response which is 
approximately the length of delay though the acoustic 
path. The coefficients of the FIR filter are modeled and 
tailored after the acoustic echo path of the echo taking 
into account the specific physical attributes of the box 
that the speaker 304 and microphone 303 are located in 
and the proximity of the speaker 304 to the microphone 
303. Thus, any signal placed on to the speaker is sent 
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service level and multiplex control level. This operation 
is shown diagram maticaily in FIG. 15. 

In transmit mode, the main controller circuit 313 of 
FIG. 3 operates in the data service level 1505 to collect 
and buffer data from both the personal computer 10 
(through the RS232 port interface 315) and the voice 
control DSP 306. In multiplex control level 1515, the 
main controller circuit 313 multiplexes the data and 
transmits that data out over the phone line 1523. In the 
receive mode, the main controller circuit 313 operates 
in the multiplex control level 1515 to de-multiplex the 
V-data packets and the C-data packets and then oper- 
ates in the data service level 1505 to deliver the appro- 
priate data packets to the correct destination: the per- 
sonal computer 10 for the C-data packets or the voice 
control DSP circuit 306 for V-data. 

Transmit Mode 

In transmit mode, there are two data buffers, the 
V«lata buffer 1511 and the C-data buffer 1513, imple- 
mented in the main controller RAM 316 and maintained 
by main controller 313. When the voice control DSP 
circuit 306 engages voice operation, it will send a block 
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through the echo cancellation function 1411 to be sub- 25 of V-data every 20 ms to the main controller circuit 313 



tracted from the signals received by the microphone 
303 after an appropriate delay to match the delay in the 
acoustic path. The formula for echo replication of func- 
tion box 1411 is: 



30 



through dual port RAM circuit 308. Each V-data block 
has one sign byte as a header and 23 bytes of V-data, as 
described in Table 15 below. 

TABLE 15 

Compressed Voice Picket Structure 



and the result of the subtraction of the echo cancellation 
signal y(n) from the microphone signal y(n) is 

«<fl)=j(ii)-y(ft). 



byte 
sign 



35 



The LMS coefficient function 1413 provides adaptive 
echo cancellation coefficients for the FIR filter of 1411. 40 
The signal is adjusted based on the following formula: 



1 I ipol I 1 


ft) 0 


Pi 


A) 1 






P3 





A** + I) - htn) + 



■ 4* - 0 



where 
i=0, . . . N-l 
N=# of TAPS 
o=Time Index 

k=1000 

The echo cancellation of functions 1415 and 1417 are 
identical to the functions of 1413 and 1411, respectively. 
The functions 1407 and 1423 of FIG. 14 are sample rate 
conversions as described above due to the different 
sampling rates of the digital telephone CODEC circuit 
305 and the voice control CODEC of circuit 306. 

Voice Over Data Packet Protocol 

As described above, the present system can transmit 
voice data and conventional data concurrently by using 
time multiplex technology. The digitized voice data, 
called V-data carries the speech information. The con- 
ventional data is referred to as C-data. The V-data and 
C-data multiplex transmission is achieved in two modes 
at two levels: the transmit and receive modes and data 
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Where 

P, - pitch (7 bin) whet* n = mbfruac number 
£„"* = Beu (3 bib) 
G, - Gain (4 bits) 
60 Vd - Voice <htt <4 x B bit*) 

Effective Bit R*te = 1M bi'U/20 msec = 9200 bp* 

The sign byte header is transferred every frame from 
the voice control DSP to the controller 313. The sign 
65 byte header contains the sign byte which identifies the 
contents of the voice packet The sign byte is defined as 
follows: 

00 hex = the following V-data contains silent sound 
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01 he* = the following V-data contains speech infor- data buffer has V-data with number more than 23 bytes, 

^ticn the transmit block counter is set 1 and starts transmit 

If the main controller 313 is in transmit mode for V-data. This means that the main <»ntroller circuit will 

V-data/C-data multiplexing, the main controller circuit only transmit one block of V-data. If the V-data buffer 

313 operates at the data service level to perform the 5 has V-data with less than 23 bytes, the main controller 

following tests. When the voice control DSP circuit 306 circuit services the transmission of C-data. 

starts to send the 23-byte V-data packet through the During the transmission of a C-data block, the V-data 

dual port RAM to the main controller circuit 313, the buffer condition is checked before transmitting the first 

mam controller will check the V-data buffer to see if the C-data byte. If the V-data buffer contains more than one 

buffer has room for 23 bytes. If there is sufficient room 10 V-data packet, the current transmission of the C-data 

in the V-data buffer, the main controller win check the block will be terminated in order to handle the V-data. 

sign byte in the header preceding the V-data packet. If Receive Mode 
the sign byte is equal to one (indicating voice infonna- 

tion m the packet), the main controller circuit 313 will On the receiving end of the telephone line, the main 

put the following 23 bytes of V-data into the V-data 15 controller circuit 313 operates at the multiplex control 

buffer and clear the silence counter to zero. Then the level to de-multiplex received data to V-data and C- 

main controller 313 sets a flag to request that the V-data data. The type of block can be identified by checking 

be sent by the main controller at the multiplex control the first byte of the incoming data blocks. Before reenv- 

J^J" y ing a block of V-data, the main controller circuit 313 

If the sign byte is equal to zero (indicating silence in 20 will initialize a receive V-data byte counter, a backup 

the V-data packet), the main controller circuit 313 will pointer and a temporary V-data buffer pointer The 

increase thesflence counter by 1 and check if the silence value of the receiver V-data byte counter * 23, the 

counter has reached 5. When the silence counter value of the receive block counter is 0 and the backup 

reaches 5, the main controller circuit 313 will not put pointer is set to the same value as the V-data receive 

the following 23 bytes of V-data into the V-data buffer 25 buffer pointer. If the received byte is not equal to 80 hex 

and will stop increasing the silence counter. By this (80 h indicating a V-data packet), the receive operanon 

method, the main controller circuit 313 operating at the will follow the current modem protocol since the date 

service level will only provide non-silence V-data to the block must contain C-data. If the received byte is equal 

multiplex control level, while discarding silence V-data to 80 h, the main controller ^ circuit 313 operating m 

packets and preventing the V-data buffer from being 30 receive mode will process the V-data. For a V-data 

^a^mtteu block received, when a byte of V-data is received, the 

The operation of the main controller circuit 313 in the byte of V-data is put into the V-data receive buffer, the 

multiploTcontrol level is to multiplex the V-data and temporary buffer pointer ts increased by 1 and the re- 

C-data packets and transmit them through the same ceivc V-data counter is decreased by 1. If the V-data 

channel. At this control level, both types of data pack- 35 counter is down to zero, the value of the temporary 

ets are transmitted by the HDLC protocol in which V-data buffer pointer is copied into the backup pointer 

data is transmitted in synchronous mode and checked buffer. The value of the total V-data counter is added 

by CRC error checking. If a V-data packet is received with 23 and the receive V-data counter is reset to 23. 

at the remote end with a bad CRC, it is discarded since The value of the receive block counter is mcreased by 1. 

100% accuracy of the voice channel is not ensured. If 40 A flag to request service of V-data is then set. If tne 

the V-data packets were re-sent in the event of corrup- receive block counter has reached 5 ; *e main control- 

tion the real-time quality of the voice transmission lcr circuit 313 will not put the incoming V-data into the 

woiild be lost. In addition, the C-data is transmitted V-data receive buffer but throw it away. If the total 

following a modem data communication protocol such V-data counter has reached its maximum value, die 
as CCITT V 42 45 receiver will not put the incoming V-data into the V- 

In order to identify the V-data block to assist the data receive buffer but throw it away, 

main controller circuit 313 to multiplex the packets for At the end of the block which is indicated oy receipt 

t^rrSi^ at his level, and to assist the remote site in of the CRC check bytes the mam controUer cn^t 313 

recognizing and de-multiplexing the data packets, a operating in the multiplex control level will not check 
V-datablock is defined which includes a maximum of 50 the result of the CRCbut instead will check the value of 

five V-data packets. The V-data block size and the the receive V-data counter. If the value is zero, the 

maximum number of blocks are denned as follows: check is finished, otherwise die value of the backup 

The V-data block header =80 h; pointer is copied back into the current V-data buffer 

The V^lata block size-23; pointer. By this method, the receiver is insured to 
The maximum V^lata block stze=5; 55 demultiplex the V-data from the receivmg channdK 3 

The V-data block has higher priority to be transmit- bytes at a time. The mam controller circuit 313 operat- 

ted than C-data to ensure the integrity of the real-time ing at the service level in 

voice transmission. Therefore, the main controller cir- theflagofrequestservKe ofV^lata. If ^S^^^ 

cuit 313 will check the V-data buffer first to determine main controller circuit 313 will get the V-data fromthe 
whether it will transmit V-data or C-data blocks. If 60 V-data buffer and transmit it to the voice control DSP 

V-oX buffer has V-data of more than 69 bytes, a trans- circuit 306 at a rate of 23 bytes at a tune. After sending 

mitWock counter is set to 5 and the main controller a block of V-data, it decreases 23 from the value m the 

circuit 313 starts to transmit V-data from the V-data total V-data counter, 

buffer through the data pump circuit 311 onto the tele- Uscr Interfacc Description 

phone line. Since the transmit block counter indicates 5 65 ft „ 

blocks of V-data will be transmitted in a continuous The hardware components of the present system are 

stream the transmission will stop either at finish the 1 15 designed to be controlled by an external computing 

bytes of V-data or if the V-data buffer is empty. If V- device such as a personal computer. As described 
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above, the hardware components of the present system signal to a control block 129 in order to make the con- 
may be controlled through the use of special packets trol block 129 active substantially once every 10 sec- 
transferred over the serial line interface between the onds. It will be recognized that other timing intervals 
hardware components and the personal computer. may be used as appropriate to the windowing system 
Those skilled in the art will readily recognize that the 5 being used without loss of generality. A status 133 is 
hardware components of the present systems may be used to preclude other applications or program blocks 
practiced independent of the software components of from taking control of a communications port by indi- 
the present systems and that the preferred software eating that the port is currently being used by the PCS. 
description described below is not to be taken in a limit- The controller 129 looks at all outbound queues in voice 
ing sense. 10 mail 117, fax manager 119, and multi-media mail 121, 
The combination of the software components and and if there is an outgoing message in one of the out- 
hardware components described in the present patent bound queues, initiates a dispatch. A signal is then sent 
application may conveniently be referred to as a Per- to the status box in order to preclude other applications 
sonal Communication System (PCS). The present sys- or program blocks from using the serial communica- 
te™ provides for the following functions: 15 tions port. 

1 . The control and hands-off operation of a telephone ^f^rconTrol'b^kal&iaisoii^ 
with a built-in speaker and microphone. andanrroteMtrwaapprop^ 

2. Allowing the user to create outgoing voice mail vroceimail»117;Tfaxiniaireger#lI9^ 

messages with a voice editor, and logging incom- or show & tell 123, in order to further process the in- 
ing voice mail messages with a time and date 20 coining call. Additionally, the control block 129 is used 
stamp. to invoke telephone functions 115, terminal emulation 

3. Creating queues for outgoing faxes including pro- functions 125, and allow users to edit the data base of 
viding the ability for a user to send faxes from addresses with the address book function 127. The con- 
unaware applications through a print command; trol block 129 further provides for the initialization of 
also allowing the user the user to receive faxes and 23 PCS parameters via the setup function 113. The main 
logging incoming faxes with a time and date stamp. menu, as it is displayed to the user, is shown in FIG. 2. 

4. Allowing a user to create multi-media messages FIG. 19 illustrates the structure of control block 129. 
with the message composer. The message can con- Upon selecting the setup function 113, the user has 
tain text, graphics, picture, and sound segments. A access to initialization functions 135 which include se- 
queue is created for the outgoing multi-media mes- 30 rial port, answer mode, hold call, voice mail, PBX, fax, 
sages, and any incoming multi-media messages are multi-media mail, and show & tell initializations. Upon 
logged with a time and date stamp. selecting telephone 115, the user has access to telephone 

5. Providing a way for a user to have a simultaneous functions 137 which include equipment select, volume 
data and voice connection over a single communi- control, and call functions as shown in the screen dis- 
cation line. 35 play of FIG. 49. Upon selecting voice mail 117, voice 

6. Providing terminal emulation by invoking an exter- mail functions 139 are provided which include a voice 
nal terminal emulation program. editor, voice messages to be sent, and voice messages 

7. Providing address book data bases for all outbound received as shown in the screen display of FIG. 50. 
calls and queues for the telephone, voice mail, fax Upon selecting fax manager 119, fax manager functions 
manager, multi-media mail and show-and-tell func- 40 141 are provided which include setup functions, faxes to 
tions. A user may also search through the data base be sent, and faxes to be received as shown in the screen 
using a dynamic pruning algorithm keyed on order display of FIG, 52. If multi-media mail 121 is selected, 
insensitive matches. multi-media mail functions 143 are provided which 

FIG. 16 shows the components of a computer system include the setup function, multi-media messages to be 
that may be used with the PCS. The computer includes 45 sent, and multi-media messages received function as 
a keyboard 101 by which a user may input data into a illustrated by the screen display shown in FIG. 53. If 
system, a computer chassis 103 which holds electrical show & tell 123 is selected, show & tell functions 145 are 
components and peripherals, a screen display 105 by provided to the user which include open, select new, 
which information is displayed to the user, and a point- and help as illustrated in the screen display of FIG. 54. 
ing device 107, typically a mouse, with the system com- 50 If the terminal function 125 is selected by the user, the 
ponents logically connected to each other via internal terminal emulation function 147 is provided to the user 
system bus within the computer. The PCS software via a terminal emulation block. If address book 127 is 
runs on a central processing unit 109 within the com- selected, address book functions 149 are provided to the 
P uter - user which include file functions, edit functions, and 

FIG. 17 reveals the high-level structure of the PCS 55 help functions as shown in the screen display of FIG. 
software. A main menu function 111 is used to select the 55. 

following subfunctions: setup 113, telephone 115, voice The setup functions 135 are accessed by an imtializa- 
mail 117, fax manager 119, multi-media mail 121, show tion menu as shown in the screen display of FIG. 40. 
& tell 123, terminal 125, and address book 127. The PCS software provides support for any communi- 

Tne preferred embodiment of the present system 60 cations port that is contained within the personal com- 
currently runs under Microsoft Windows <g) software puter. FIG. 41 shows the screen display shown to a user 
running on an IBM ® personal computer or compati- to enable a user to select a specific communications port 
ble. However, it will be recognized that other imple- to be used by the PCS software. A user may also specify 
mentations of the present inventions are possible on what action is to be taken by the PCS software when an 
other computer systems and windowing software with- 65 incoming call arrives. The screen display of FIG. 42 is 
out loss of scope or generality. shown to the user while FIG. 20 describes the full con- 

FIG. 18 describes the control structure of the main trol of the answer mode setup initialization procedure, 
menu 111 in greater detail. A timer 131 sends a timing Upon selecting answer mode setup 151, the user is pres- 
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en ted with eight answer mode choices 153 and de- 
scribed as follows: 

1. PCS does not answer. The PCS software does not 
answer an incoming call and the telephone equip- 
ment acts as normal. 

2. Voice mail. The PCS software answers the incom- 
ing call and acts as an answering machine to record 
messages. 

3. Fax. The PCS software answers the incoming calls 
and acts as a fax machine. 

4. Multi-media mail. The PCS software answers the 
incoming call and receives multi-media mail that is 
being sent by a remote caller. 

5. Show A tell. The PCS software enables simulta- 
neous data and voice communication using the 
same communication tine. 

6. Terminal. The PCS provides terminal emulation 
through a terminal emulation block, or optionally 
transfers control to a third party terminal emula- 
tion program. 

7. Automatic. The incoming call is analyzed and the 
appropriate mode is automatically entered. 

The user may additionally enter a numeric value 
which represents the number of rings to wait before the 
PCS software answers an incoming call. 

If from the setup functions 135 the hold call function 
is selected, the hold call display as illustrated in FIG. 43 
is shown to the user, who may then enter a numeric 
value to specify the number of hours all outgoing calls 
are to be held. If at setup functions 135 the voice mail 30 
setup option is selected, the screen display as illustrated 
in FIG. 44 is displayed to the user who may then enter 
a file name to be used as a greeting file for all incoming 
calls. If at setup functions 135 the PBX setup function is 
selected, the screen display of FIG. 45 is shown to the 35 
user who may then enter a dialing prefix to be applied to 
any outgoing telephone number. This provides for an 
easy way to use a list of telephone numbers with an 



queues: the first for voice mail messages to be sent and 
the second for voice mail messages received. In the send 
queue a user may add messages to the queue, listen to 
messages in the queue, delete messages from the queue, 
5 or refresh the send queue display. With the receive 
queue a user may listen to messages m the queue, store 
messages in the queue, delete messages from the queue, 
forward messages from the queue to another voice mail 
user, or refresh the queue. The voice mail editor as 
10 shown to the user in FIG. 51 allows the user to select 
file functions to open or save a voice mail message, edit 
functions for editing a voice mail message, playing, 
recording, and pausing a voice mail message, and ad- 
justing the play volume and the record volume. The 
user may also optionally select between a speaker 
phone, headset, and handset. 

FIG. 52 illustrates the fax manager display as shown 
to the user. FIG. 23 illustrates the fax manager functions 
159 that are available to a user after selecting the fax 
manager function 119 from the main menu 111. The fax 
manager function provides for two queues: the first for 
faxes to be sent and the second for faxes that are re- 
ceived. When reviewing the first queue of faxes to be 
sent, the user may preview a fax, print a fax, delete a fax 
from the queue, refresh the send fax queue, or forward 
a fax to another user. When reviewing the second queue 
of received faxes, the user may view a fax, print a fax, 
delete a fax, refresh the received fax queue, forward a 
fax to another user, or store a fax. 

FIG. 53 describes the multi-media mail display that is 
shown to the user. FIG. 24 describes the multi-media 
mail functions 161 that are available to a user upon 
selecting the multi-media mail function 121. Upon se- 
lecting multi-media mail the PCS software provides for 
setup, composing a message with the message com- 
poser, or allowing the user to view and edit multi-media 
messages in two queues: the first queue having multi- 
media messages to be sent and the second queue having 
multi-media messages that have been received. When 
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in-house PBX system without making modification to _— „ . 

the telephone number list. If at setup functions 135 the 40 reviewing the first queue of send messages, a user may 

fax setup function is selected, the screen display of FIG- add messages to the queue, preview messages in the 

46 is displayed to the user who may then enter a nu- queue, delete messages from the queue, or change attn- 

meric value which represents the number of times to butes of messages in the queue. When a user is accessing 

attempt to send a fax before timing out. If at setup func- the second queue of multi-media messages that have 

tionsl35 the multi-media mail setup function is selected, 45 been received, the user may view messages, store mes- 

the display of FIG. 47 is shown to the user who may sages, delete messages, forward messages to another 

then enter the name of a file to be used for user informa- user, or refresh the queue. 

tion If at setup functions 135 the show & tell function is FIG. 54 illustrates the display shown tothe user upon 

selected, the screen display of FIG. 48 is shown to the selecting the show & tell function 123 from the main 

user who may then enter show & tell user information. 50 menu 111. FIG. 55 illustrates the display that is shown 



FIG. 49 shows the telephone control function display 
as shown to the user. FIG. 21 further illustrates the 
steps and options 155 available when the telephone 
control function 115 is selected. The user may use the 



to the user upon selecting the address book function 127 
from the main menu 111. A user may open a previously 
stored address book file or may edit an existing address 
book file by adding, deleting, or changing entries that 



mouse to select between a speaker phone, a handset, or 55 are in the file. Additionally, the PCS software provides 

... . ■ r ...„L tVawnnti tha Aata Hod*, nv nemo » 



a headset to be used with the communications device, 
and may adjust the volume of the speaker with a first 
logical slider switch, and the gain of the microphone 
with a second logical slider switch, both slider switches 



for a user to search through the data base by using a 
dynamic pruning algorithm keyed on order insensitive 
matches. As the user enters a search string at a dialogue 
box, the list of matches displayed is automatically up- 



being displayed on the screen. During a call, the user 60 dated in real time to correspond to as much of the 

r J i . i . i_ «W.+ k*> t>1»osiu Kmw MitWfl. I tip list 



may select to save a telephone number, redial a tele- 
phone number, record a call, flash between calls, mute 
a call, or place a call on hold. 

FIG. 22 shows the voice mail functions 157 that are 
available upon selecting voice mail 117. A user may set 65 
up a voice mail greeting file or may edit a voice mail 
message by selecting the voice mail editor as shown in 
FIG. 50. The PCS software provides for two voice mail 



search string that has already been entered. The list 
continues to be updated until the search string has been 
completely entered. 

Software Control Description 

The preferred embodiment of the software control 
system of the present invention runs under Microsoft 
Windows software on an IBM PC or compatible. It will 
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be recognized that other software implementations are either a new file or record at 2601, open an existing file 
available on other types of computers and windowing at 2613, or abort at 2625. Upon selecting a file or record 
systems without loss of generality. at 2603, the file may be saved at 2611 or the user may 

FIG. 25 shows the timing loop 131 of FIG. 18 in select options at 2605. The selectable options include 
greater detail. In order to process pending actions, the 5 setting the volume or record levels at 2607, or selecting 
timer 131 checks the fax out queue at 163, the multime- between a handset, a headset, or a speaker phone at 2609 
dia out queue at 165, the voice mail out queue at 167, as shown to the user by the voice mail editor display 
and the communication port at 169. The three output given in FIG. 51. If an existing file is opened at 2613, the 
queues and the communication port are checked sub- file name is selected at 2615 whereupon a user may then 
stantially once every 10 seconds to determine if there 10 play the file at 2617 or select options at 2619, The select- 
are any pending actions to be performed. If the timer able options from 2619 include setting the volume or 
does find a pending action in one of the queues, or if record levels at 2621 or selecting between a headset, 
there is information coming in from the communication handset, or speaker phone at 2623. Once a voice mail 
port, a secondary timer of duration 100 mfliseconds is message has been recorded or opened from a previous 
spawned in order to handle each pending action. This 15 session, a graphical representation of the voice mail 
polling of the output queues continues as long as the message is displayed in a window with x and y dimen- 
main PCS software is active and running. The polling sions, where the x dimension represents time and the y 
interval rate of substantially 10 seconds is short enough dimension represents the volume of the voice mail mes- 
such that there is no significant time delay in handling sage at that point in time. The pointing device may be 
any pending action in any of the output queues. It will 20 used to modify the voice message by graphically chang- 
be recognized that short timing intervals other than ing the two dimensional voice message plot. The cursor 
substantially 10 seconds may be used without loss of is placed within the two dimensional voice message plot 
generality. in OIX j er to indicate the portion of the voice message to 

FIG, 38 illustrates the flow control for the outgoing be modified. A scroll button beneath the two dimen- 
queue timer. The incoming timer is stopped at 3701 and 23 sional voice message plot may be used to select the time 
the communication port is initialized at 3703. A job portion of the message to be displayed within the two 
record 3707 is used to determine the destination for this dimensional plot window. Time is shown increasing 
message and dial the telephone at 3705. After a protocol from the left to the right, corresponding to the x axis of 
handshake at 3709, an output page is sent at 3711 which the plot. As the scroll button is moved to the right, later 
may include a fax code file 3713. The remaining number 30 portions of the voice message are displayed. As the 
of pages to be sent is checked at 3715, and if there are scroll button is moved to the left, earlier portions of the 
more pages, control returns to 3709 so that the addi- voice mail message are displayed. A numeric value is 
uonal page or pages can be sent to the destination. Oth- shown substantially on the left side of the two dimen- 
erwise, if at 3715 there are no more pages to be sent, the sional plot window which is updated continuously and 
Job record 3707 is updated at 3717 and the incoming 35 corresponds to the time value of the current location on 
time is restarted at 3719. the x axis. 

FIG. 39 illustrates the flow control for the incoming Upon the recording of a voice mail message, the 
queue timer. At 3801 the communication port is initial- voice mail may be added to the voice mail send queue as 
ized, and the software waits for a ring indicator from an displayed to the user in FIG. 50 and described at 159 in 
incoming call at 3803. After receiving a ring, the soft- 40 FIG. 23. Upon adding a voice mail message to the voice 
ware answers, establishes a connection via a protocol mail queue, the user is prompted as shown in FIG. 56 to 
handshake at 3805, and receives input data at 3807. If at enter a name and a telephone number to whom the 
3809 there is more data to be received, control passes voice mail message must be sent. The user may select 
back to 3805 so that the pending data may be received. from a predetermined list of voice mail recipients previ- 
Otherwise, if at 3809 there is no more data to be re- 45 ously set up in the address book as shown to the user in 
ceived, the call is terminated at 3811. FIG. 55. 

FIG. 26 shows the control software used for a hands- FIGS. 28 and 29 show how the fax code drivers of 
off telephone. The telephone control software is in- the PCS software typically work. The fax capability is 
voked upon selection of the telephone option 115 tied to the windowing system print command so that 
shown in FIG. 2. Upon selection of the telephone op- 50 facsimile transmissions may be sent by any software that 
tion at 2501, any timers that have been spawned or are can print through the windowing environment. At 2701 
currently running are disabled, and at 2503 the commu- in FIG. 28, a high resolution fax driver examines a print 
nicatton port for the personal computer is initialized. At file at 2703 that has been printed by a windowing system 
2505 the telephone control software handles any op- application. The print file is then converted and imaged 
tions that have been selected by the user as displayed to 55 at 2705 into a PCX bit-mapped format which of the 
the user by FIG. 49. At 2507 the user may logically correct horizontal and vertical resolution in dots per 
select between a headset, handset, or speaker phone, at inch (dpi) for high resolution facsimile devices. FIG. 29 
2509 the user may adjust the volume level of the speaker shows an equivalent process used by a low resolution 
or the gain of the microphone, and at 2511 the user may fax driver at 2801. A print file 2803 is converted at 2805 
select between mute, hold, record, and redial functions 60 to a low resolution PCX bit-mapped format for use with 
for the hands-off telephone. After the user selects op- low resolution facsimile devices. Upon converting a 
tions at 2513, a telephone number is dialed and the call print file to a facsimile document, the facsimile docu- 
initiated. After the call is complete, at 2515 the user ment may be added to the fax out queue as displayed to 
hangs up, and at 2S17 any timers that had been stopped the user in FIG. 52. The user may select the name and 
at 2503 are restarted and at 2519 the communication 65 telephone number of a person to send the fax to through 
port is restored to its previous state. the address book function as shown to the user in FIG. 

FIG. 27 shows the voice mail control software that is 55. Received faxes may be viewed or printed from the 
mvoked by option 117 from FIG. 2. The user may select fax in queue. 
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FIG. 30 shows the multi-media control software that 
is invoked by a user selecting multi-media option 121 
shown to a user in FIG. 2. The user may initialize multi- 
media mail settings at 2901, select various multimedia 
mail options at 2905, or invoke a message composer at 
2903 as shown to the user by the screen display of FIG. 
57. In the message composer 2903, the user may open a 
new file at 2907 or cancel the message composer at 291 1 
or open an existing file at 2909. Upon opening an exist- 



indicator. If, after a predetermined amount of time, no 
ringing indicator is detected, a timeout occurs at 3407 
whereupon the PCS software aborts are returns at 3409. 
Otherwise, at 3411 a ring indicator is received, the data 
over voice connection is established at 3413, and the 
user may select options at 3415 either to quit the PCS 
software at 3419 and close the communication port at 
3421, or invoke terminal emulation at 3417. 
FIG. 36 shows the control procedure used when 



iiuv/ugu ou »"'^~«— - - — 

options available that are shown to the user by the mul- 
ti-media edit display of FIG. 57 at 3001 the file line edit, 
block edit, fonts, paragraph, voice, "other", and help 



Or UDCIl Oil GAiSUllg at. a^rvjr. vpu- w — "B ■ -1 

ing file, the file name b selected is 2913 and the mum- 10 transmitting voice mail messages. At 3501 a voice mail 
media mail editor 2917 is invoked at 2915. While editing message is added to the send queue, whereupon at 3503 
a file at 2919 a user may select to alternately play a the user specifies the message file name, and at 3505 
message at 2921 or record a message at 2923. The user indicates a name from a previously entered address 
may edit in line mode either inserting, deleting, joining, book entry 3505 and destination telephone number 3507 
or splitting lines, edit in block mode by moving, copy- 15 to send the message to. The message is then added to the 
ing, deleting, or highlighting blocks of text, changing job list at 3509, and the queue display is updated at 3511. 
the font used to display the text, or changing the indent FIG. 37 shows the control procedure used when 
and justification attributes of paragraphs of text. Stan- receiving voice mail messages. At 3601 a voice mail 
dard search features such as forward and backward message is received and recorded by the PCS software, 
search and global search and replace are also available 20 At 3603 the user selects a message to be reviewed or 
through an "other" menu. FIG. 31 further describes the edited, after which the software opens the job list at 

- * * ' 3605, loads the selected recorded message into memory 

at at 3607, and invokes the voice editor at 3609 with the 

□ice* cuu, mm*, poi^^u, , r selected recorded message. The user may then select 

options are available. If at 3001 the user selects "file", 25 various functions from within the voice editor to review 
the options shown in 3003, save, save as, page layout, or edit the message as previous described above. 

orinter setup, and print, are available to the user. If at ^ . . - 

3001^^; selects ^oice" the options available at Data Structures Description 

3005, record voice, stop recording, play voice, stop Descriptions of the data structures and variable 
play, store voice to disk, and get voice from disk, are 30 names and types are given below for the preferred em- 
available to the user. After selecting from edit controls bodiment of the present invention. The preferred era- 
3001, at 3007 the appropriate action is taken by the PCS bodiment is written the in C programming language 
software, the voice icon is displayed, and any additional r]ins under Microsoft Windows software on an IBM PC 
graphics are also displayed. or compatible system, however, it will be recognized 

After a multi-media message has been created, at 3101 35 thcse data structures and methods are generic and 
the user may add a message to the send queue. Upon potentially useful for a wide variety of other windowing 
adding the message, at 3103 the user selects the name software, systems, and programming languages, 
and telephone number of a person to send a message to, Address Book 

or at 3105 selects a name from the address book and at Address key types are used to indicate how informa- 
3107 selects a destination from the address book to send 40 tion the address book should be displayed to the 

the message to. The message is then added to the j ob list USCf . 
at 3109 at 3111 the job scroll list is updated. 

FIG. 33 shows the options available when a multi- 
media message has been received. At 3201 the user may 
select and view the message. At 3203 the software se- 45 
lects the appropriate message, opens the job list at 3205, 
loads the received message at 3207 and invokes the 
message composer at 3209 in order to display the re- 
ceived multi-media message. 

FIG. 34 shows the software control procedure used 50 
with the show and tell feature to provide data over 
voice capability when selected at 123 from FIG. 2. At 
3301 any existing timers are disabled and the communi- 
cations port is initialized at 3303. The destination for 
any messages is accessed from the address book at 3305, 55 
whereupon the telephone number is dialed and the con- 
nection is set up at 3307. Upon detecting a successful 
connection, the data over voice mode is initialized at 
3309 while a message is being transmitted at 3311 the 
user may select options of either quitting PCS at 3315, 
or invoking a terminal emulation at 3313. The data over 
voice connection is accomplished by multiplexing the 
bandwidth of the connection as described elsewhere in 

this Specification. J . K^NJn^KEY^TYPE^COUNTI - 

FIG. 35 shows the control procedure used when 65 ..^^..^ 
receiving data over voice messages. At 3401 any exist- 
ing timers are disabled and the communications port is 
initialized at 3403. At 3405 the software waits for a ring 
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The address entry structure defines what fields are 
associated with each address book entry: 



s_ addr ~« itract 
unsigned bit delFlag; 
unsigned int caName; 
unsigned int caAffttiatioii; 
^0 unsigned int caStreetAdis; 
Turri gnfH bt caCityState; 
unsigned ml caZip; 
unsigned ml caPhone; 
unsigned hit caFax; 
unsigned int cnMbc; 



delete flag 
Name field 
Affiliation field 
Street Address field 
City State field 
Zip field 

Phone Number field 
Fax N amber field 
Miscellaneous field 



"Na 
"Affiliation**, 
"StrcetAdrs", 
"CityState", 
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-Zip", 
"Phone", 
"Fax", 
"Misc" 



The following character strings are used to hold ad- 
dress book information: 



char 



g-adrcbooktanp{MAX_FlLE-NAME_ 
"temp-adr"; 



.LEN] ■ 



Lnt zTries; 

char rType; 

char zDummy[]9]; 
} t_jobDesc •tp.JobDesc. far 'tpLjobDesc; 
sutict—jobDesc g_curJob, g_budob; 



Multi Media Send and Receive Queues 
The following structure definition is used to indicate 
10 how information within the multi media send and re- 
ceive queues is stored: 



static char g_Clipbo»rd Format Q = "CF—FLOOOM"; 

static char g_ adrsboakDlgNarocQ - "AdrsBkDJg"; 

itatk char g — adr$b(X>kFdcNaii»c[MAX_FILE_NAME-JLEN]; 

static char g_ FarStr|AX>DRESS_ENTTRy_FIELD_SIZE]; 

static char g_PhoneSlr{ ADDRESS _ENTRY_FIELD_SIZE]; 

static char g — NairxStr[ADPRESS ENTRY_FIELD_SIZE]; 



IS 



Fax Send and Receive Queues 

A structure definition is used to indicate how infor- 20 
mation within the fax send and receive queues is stored: 



struct s_jobDesc { 
union { 

unsigned char phoneNam[32]; 

short nbrOOobs; 
}ul; 
union { 

short nextTobNum; 

unsigned char d»te[16]; 
} o2; 

unsigned char tiUe[64); 
unsigned char receiver{32], 
unsigned char coverFile{321; 
unsigned char telNum[32]; 

unsigned char faxCdFilc{8]; 

unsigned char thnc[8]; 

WORD zstate; 



25 



30 



struct &„jobD«c { 
union { 

unsigned char phoscNum[32]; 
short nbrOOobs; 
}ol; 
union { 
short nextlobNom; 
unsigned char date(l6]; 
>u2; 

unsigned char title[64]; 

unsigned char recerver[32]; 

unsigned char coverKlep2|; 

unsigned char telNum£32), 
unsigned char MMCdFile[8j; 
unsigned char time[8]; 
WORD zstate; 
time— t zTime; 
short z Pages; 
short zResuli; 
inlzTries; 
char zType, 
char zDummyfl9]; 
} i—jobDesc, •tp_jobDesc far •tpLjobDesc; 



Show and Tell 
35 The show and tell structure definition is the same as 
that used in the address book. The static variables to 
define field sizes are given below: 



Static Variables Used For Address Book Proc. The Variable 
Names Are Same As The Ones In "AdrebooL", So That Same 
Modules Could Be Used 



time_t zTune; 
short zPages; 
short zResult; 



#<kfinc ADDRESS— ENTRY_FIELD_SIZE 

^define NUM_MEMBERS_ADRS_ STRUCT 

^define NUM_ADRS_FTELDS 

#drfmc VAL-PAUSE 

jMefme PCKT_COM_TIME 

^define WATT—RING— TIME 

#defiac DIAL_TIME 

//I029 vasantb for delay before % pi command 
fjfdeftne DELAYTIME 
/* Address Key Types •/ 

#define KEY NAME 

•/ 

#defme KEY—AFFILIATION 

*deftne KEY STREETADRS 

#defme KEY_CITYSTATE 

iWefine KEY_ZIP 

^define KEY_FHONE 

^define KEY_FAX 

^define KEY_M1SC 

# define KEY _TYPE_ COUNT 



64 




8 




8 




2000 




20 




120 




60 




10 




0 


/* list addresses by name 


1 


/* by affiliation •/ 


2 


/• by streetadrs code */ 


3 


f* by citystate code •/ 


4 


/* by rip code •/ 


5 


/* by phone code V 


6 


/* by fax code V 


7 


/* by raise code V 


3 


/* number of key types V 



Voice Mail Send and Receive Queues 

The voice mail structure definition and static vari- 
ables to define field sizes are given below: 



#defn»e READCOUNT 
#define FRAME-SIZE 
#dcfinc SCROLL— STEP 



24000 
2000 
4 
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-continued 

^define POS_IN_PAGE 100 

#defi« T_posrnoN 002 

0 define COMP_FRAME SZ 24 

# define BYTES IN—FRAME 12000 

^define BYTE-NUMBER * 

# define WAVE-COEF 1 

define FORMAT—STR 1 "% * — % s # % s Schedule: %%;% s" 

# define FORMAT—STR2 "% s — % s # % s Sent: % fc % s" 

If define OUT_JOBS_FILE_NAME "jobs" 

# define IN IOBS FILE — NAME "jobs" 

♦define MAX_JOBS 10 
struct s— jobDesc { 

union { 

unsigned char pboneNuni[32]; 
short nbrOOobs; 
}»X; 
union { 
short nexUobNum; 
unsigned chardate(16]; 
}u2; 

unsigned char tiUc[64]; 

unsigned char receiver[32J; ~ 

unsigned char cover File[32t 

irmigp*** char telNum[32]; 
unsigned char faxCdFilefSJ; 
unsigned char dme{8]; 
WORD wtate; 
rim» t zTimc; 
short zPiges; 
short zResult; 
int zTrics: 
Char xType; 
Char zDurarny[l9); 
} t_jobDcsc tp_jobDese, far *tpL-jobD**c; 
static HWND hwodVMDlg; 

static int g__ciWave /• width of waveform window V 

static int g_ cyWave /* height of waveform window */ 

static int g__nS*mplcs /* sample counter V 

static char g_outVMDirJMAX_FlLE__NAME — LEN}; 

static char g_iaVMDir(MAX — FILE_NAME_LEN); 

stalk HANDLE g_ouUobsHndl = 0; 

static HANDLE g_inJobsHodl = 0; 

static HANDLE g_jobHleHndt = O. 

static t_jobDe*c g_outJobcO; 

static t_jobDeac g—outlobsn; 

static t_jobDesc g_iitfobsQ; 

static t—jobDesc g_mJobsn; 

static short g nurnOfUutJoba - 0; 

static short g numOflnJobt = 0; 

static int g_VMOutl» = — I; 

static int g_VMInl* - - 1; 

static OFSTRUCT jOfStruct ; 

static F ILE * vdata ; 

static OFSTRUCT OfStruct 

Static in I hFik ; 

static OFSTRUCT oOfStruct ; 

static int hoFile ; 

static char g_inFileNarae[MAX_FlLE NAME — LENJ 

static iat bjFile ; 

static char g_jTUeName[MAX_FILE— NAME-LEN] 
static char g_uFUeN*me{M AX_ FILE — NAME — LEN] 
static char g_joFikName]MAX_FILE_NAME — LEN] 
static char g_sendListenFile[MAX_FlLE_NAME — LEN] 
static char g recLitfenFUefMAX FILE_NAME — LEN] 



The following arc variables to be used to write the 
playback or record level into the pcs.ini volume field 
names: 

char •guPlayVolume=*'Play Volume"; 

char *g i jRec Volume = "Record Volume"; w 

Default volume levels for record and play: 



int g_recPos = S; 
int g_playPos = 3; 

char g_ Micro Vol(10J = **>MV0"; Microphone level to be 65 

used for recording. 

char g-JPtayVoltlO) = ->SVCT; Speaker level to be used 

Tor play. 

int g_ofThV - FALSE; Off book flsg indicating thai 



-continued 

either record or play is in 
progress. If flag s set only 
then send pyfrrt commands 
to increase/decrease 
volume level. 



Below are given Static Variables Used For Address 
Book Proc. The Variable Names Are Same As The 
Ones In 



"AdnboolLc", So That Same Modules Could Be Used. 
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-continued digital voice data packets, and for sending the in- 

# define max_K£c_vol n coming computer digital data packets to the per- 
#define min_vol_xevel o sonal computer through the communications inter- 
im !2£[l!^^ 5 ,? < face means and for sending the compressed incom- 
#S JSB^sS^eld_size « 5 m « voice *** P^kets to the compression 
#define KUM_MEMBERS_ADRS_STRUCT s means, each of the incoming computer digital data 

#dcfine NUM—ADRS—FlELDS g packets having headers; 

the personal computer operable for executing soft- 

The present inventions are to be limited only in ac- warc to communicate with the communications 

cordance with the scope of the appended claims, since module through the communications interface and 

others skilled in the art may devise other embodiments operable for initiating a telephone call to a remote 

still within the limits of the claims. site in response to the commands by the local user 

w . _ . . and for causing the main control means of the com- 

Microfiche Appendix munitions module to perform multiplexing and 

The microfiche appendix to the present patent appli- demultiplexing; and 

cation contains the source code for the software run- the personal computer further operable for receiving 

ning on the personal computer and the source code for and storing the incoming computer digital data 

the software running on the voice control DSP/CO- packets received from the communications module 

D f-J" . „ over the communications interface and for trans- 

We claim: mitting the outgoing computer digital data packets 

1. A multifunction communication system for use to the communications module over the communi- 

with a personal computer, the personal computer hav- cations interface. 

ing a processor, memory, and a peripheral data store, 2. The system according to claim 1 wherein the com- 
compnsing: . , munications module further includes acoustic echo can- 
a communicauons module connected to the personal 25 cellation means for removing at least a portion of the 
^fT' * e ™dule compnsmg: incoming digital voice data from the outgoing digital 
ZZSLt^ mCaDS 1 COnnccted or voice data for acoustic echo cancellation. & & 
Z^nZ ZL L f ° r 3 - Tne system according to claim 1 wherein the com- 
r ^^0^^ COmPUtCr *> l"", module further includes line echo cancella- 
telephone line interface means for connection to a whTZi Z ^Tf * T ' °I 
telephone line and for full duplex digital commu Z.W » ^ T ^ mC ° mmS ^ VOU * 
nication over the telephone Une; * dato for line echo cancellation 
telephone voice interface means for receiving local * ,™ e system ^ dtng to 1 whci ^ main 
voice signals from a local user and for conveying 35 mean f S 18 fu ? her operable for receiving incora- 
remote voice signals from a remote user to the local "! g , data from ^ teIe P hone lloe through the tele- 
user- phone line interface means and forwarding the incom- 
full-duplex conversion means for converting the local ^6 data to the personal computer through the corn- 
voice signals into outgoing digital voice data and munications interface means and for receiving outgoing 
for converting incoming digital voice data into the 40 toU fTom the personal computer through the corn- 
remote voice signals; munications interface means and sending the outgoing 
compression means for compressing the outgoing f M ^ta to the telephone line through the telephone line 
digital voice data into compressed outgoing digital lnterface means - 

voice data packets and for decompressing com- 5l T* 1 ? svs tem according to claim 1 wherein the com- 
pressed incoming digital voice data packets into the 45 mu . I " ca ^ ons interface means is connected for communi- 
incoming digital voice data, each of the com- eating to a communications port of the personal com- 
pressed outgoing digital voice data packets having puter for transferring data between the personal corn- 
headers and each of the compressed incoming digi- puter and the communications module, 
tal voice data packets having headers; *• ^ e system according to claim 1 wherein the corn- 
main control means for receiving the compressed 50 munications interface means is connected for communi- 
outgoing digital voice data packets from the com- eating directly to a bus of the personal computer for 
pression means, for receiving outgoing computer transferring data between the personal computer and 
digital data packets from the personal computer ,ne communications module. 

through the communications interface means, for ^ e system according to claim 1 wherein the mam 
multiplexing the compressed outgoing digital voice 55 control means is further operable for receiving the corn- 
data packets and the outgoing computer digital pressed outgoing digital voice data packets from the 
data packets to produce multiplexed outgoing digi- compression means and for forwarding the compressed 
tal data and for sending the multiplexed outgoing outgoing digital voice data packets to the personal corn- 
digital data to the telephone line interface means puter; and 

for digital transmission over the telephone line; 60 the personal computer is further operable for receiv- 

the main control means further for receiving multi- ing and storing the compressed outgoing digital 

plexed incoming digital data from the telephone voice data packets received from the communica- 

hne interface means from the telephone line, the tions module over the communications interface 

multiplexed incoming digital data containing in- and for storing the compressed outgoing digital 

coming computer digital data packets multiplexed 65 voice data on the peripheral data store, 

with the compressed incoming digital voice data 8. The system according to claim 1 wherein the main 

packets, for demultiplexing the incoming computer control means is further operable for receiving the cora- 

digital data packets and the compressed incoming pressed incoming digital voice data packets and for 
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forwarding the compressed incoming digital voice data 
packets to the personal computer; and 
the personal computer is further operable for receiv- 
ing and storing the compressed incoming digital 
voice data packets received from the communica- 
tions module over the communications interface 
and for storing the compressed outgoing digital 
voice data on the peripheral data store. 
9. The system according to claim 8 wherein the per- 
sonal computer is further operable for retrieving the 
compressed incoming digital voice data from the pe- 
ripheral data store, for modifying the compressed in- 
coming digital voice data to create modified com- 
pressed incoming digital voice data and for storing the 



modified compressed incoming digital voice data onto 
the peripheral data store. 

10. The system according to claim 1 wherein the 
telephone line is an analog telephone line and the tele- 

5 phone line interface means is further operable for modu- 
lating the multiplexed outgoing digital data into a mod- 
ulated analog signal for full duplex digital communica- 
tion. 

11. The system according to claim 1 wherein the 
10 telephone line is a digital telephone line and the tele- 
phone line interface means is further operable for send- 
ing the multiplexed outgoing digital data over the tele- 
phone line as unmodulated digital data for full duplex 
digital communication. 

15 • * * * * 
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